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Abstract 



We consider a population subdivided into two denies connected by migration in which se- 
lection acts in opposite direction. We explore the effects of recombination and migration on 
the maintenance of multilocus polymorphism, on local adaptation, and on differentiation by 
employing a deterministic model with genie selection on two linked diallelic loci (i.e., no domi- 
nance or epistasis). For the following cases, we characterize explicitly the possible equilibrium 
configurations: weak, strong, highly asymmetric, and super-symmetric migration, no or weak 
recombination, and independent or strongly recombining loci. For independent loci (linkage 
equilibrium) and for completely linked loci, we derive the possible bifurcation patterns as 
functions of the total migration rate, assuming all other parameters are fixed but arbitrary. 
For these and other cases, we determine analytically the maximum migration rate below which 
a stable fully polymorphic equilibrium exists. In this case, differentiation and local adapta- 
tion are maintained. Their degree is quantified by a new multilocus version of F^t and by 
the migration load, respectively. In addition, we investigate the invasion conditions of locally 
beneficial mutants and show that linkage to a locus that is already in migration-selection 
balance facilitates invasion. Hence, loci of much smaller effect can invade than predicted by 
one- locus theory if linkage is sufficiently tight. We study how this minimum amount of linkage 
admitting invasion depends on the migration pattern. This suggests the emergence of clusters 
of locally beneficial mutations, which may form 'genomic islands of divergence'. Finally, the 
influence of linkage and two-way migration on the effective migration rate at a linked neutral 
locus is explored. Numerical work complements our analytical results. 



Key words: Selection, Migration, Recombination, Population subdivision, Genetic archi- 
tecture, Multilocus polymorphism, Fixation index 
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1 Introduction 



Migration in a geographically structured population may have opposing effects on the genetic 
composition of that population and, hence, on its evolutionary potential. On the one hand, 
gene flow caused by migration may be so strong that it not only limits but hinders local 
adaptation by swamping the whole population with a genotype that has high fitness in only 
one or a few demes. On the other hand, if migration is sufficiently weak, gene flow may 
replenish local populations with genetic variation and contribute to future adaptation. In 
this case, locally adapted genotypes may coexist in the population and maintain high levels 
of genetic variation as well as differentiation between subpopulations. For reviews of the 
corresponding, well developed one-locus theory, see Karlin (1982), Lenormand (2002), and 
Nagylaki and Lou (2008). 

If selection acts on more than one locus, additional questions arise immediately. For 
instance, what are the consequences of the genetic architecture, such as linkage between 
loci, relative magnitude of locus effects or epistasis, on the degree of local adaptation and 
of differentiation achieved for a given amount of gene flow? What are the consequences for 
genetic variation at linked neutral sites? What genetic architectures can be expected to evolve 
under various forms of spatially heterogeneous selection? 

For selection acting on multiple loci, the available theory is much less well developed than 
for a single locus. One of the main reasons is that the interaction of migration and selection, 
even if the latter is nonepistatic, leads to linkage disequilibrium (LD) between loci (Li and 
Nei 1974, Christiansen and Feldman 1975, Slatkin 1975, Barton 1983). LD causes substantial, 
often insurmountable, complications in the analysis of multilocus models. Therefore, many 
multilocus studies are primarily numerical and focus on quite specific situations or problems. 
For instance, Spichtig and Kawecki (2004) investigated numerically the influence of the number 
of loci and of epistasis on the degree of polymorphism if selection acts antagonistically in two 
demes. Yeaman and Whitlock (2011) showed that concentrated genetic architecture, i.e., 
clusters of linked, locally beneficial alleles, evolve if stabilizing selection acts on a trait such 
that the fitness optima in two demes differ. 

Linkage disequilibrium is also essential for the evolution of recombination. The evolution 
of recombination in heterogeneous environments has been studied by a number of authors 
(e.g., Charlesworth and Charlesworth 1979, Pylkov et al. 1998, Lenormand and Otto 2000), 
and the results depend strongly on the kind of variability of selection across environments, 
the magnitude of migration, and the sign and strength of epistasis. 

Recent years have seen some advances in developing general theory for multilocus migration- 
selection models. The focus of this work was on the properties of the evolutionary dynamics 
and the conditions for the maintenance of multilocus polymorphism in limiting or special 
cases, such as weak or strong migration (Burger, 2009a,b), or in the Levene model (Nagylaki 
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2009; Burger 2009c, 2010; Barton 2010; Chasnov 2012). This progress was facilitated by the 
fact that in each case, LD is weak or absent. 

Using a continent-island-model framework, Burger and Akerman (2011) and Bank et al. 
(2012) analyzed the effects of gene flow on local adaptation, differentiation, the emergence 
of Dobzhansky-Muller incompatibilities, and the maintenance of polymorphism at two linked 
diallelic loci. They obtained analytical characterizations of the possible equilibrium configu- 
rations and bifurcation patterns for wide ranges of parameter combinations. In these models, 
typically high LD is maintained. In particular, explicit formulas were derived for the maxi- 
mum migration rate below which a fully polymorphic equilibrium can be maintained, as well 
as for the minimum migration rate above which the island is swamped by the continental 
haplotype. 

Here, we explore the robustness of some of these results by admitting arbitrary (forward 
and backward) migration between two demes. This generalization leads to substantial math- 
ematical complications, but also to new biological insight. Because our focus is on the con- 
sequences of gene flow for local adaptation and differentiation, we assume divergent selection 
among the demes, i.e., alleles A\ and B\ are favored in deme 1, and Ai and Bi are favored in 
deme 2. The loci may recombine at an arbitrary rate. By ignoring epistasis and dominance, 
we assume genie selection. Mutation and random drift are neglected. Because we assume 
evolution in continuous time, our model also describes selection on haploids. 

The model is set up in Section 2. In Section 3, we derive the equilibrium and stability struc- 
ture for several important special cases. These include weak, strong, highly asymmetric, and 
super-symmetric migration, no or weak recombination, independent or strongly recombining 
loci, and absence of genotype-environment interaction. In Section 4, we study the dependence 
of the equilibrium and stability patterns on the total migration rate while keeping the ratio 
of migration rates, the recombination rate, and the selection coefficients constant (but arbi- 
trary). In particular, we derive the possible bifurcation patterns for the cases of independent 
loci (linkage equilibrium) and for completely linked loci. With the help of perturbation theory, 
we obtain the equilibrium and stability configurations for weak or strong migration, highly 
asymmetric migration, and weak or strong recombination. For these cases, we determine the 
maximum migration rate below which a stable, fully polymorphic equilibrium is maintained, 
and the minimum migration rate above which the population is monomorphic. Numerical 
work complements our analytical results. 

The next four sections are devoted to applications of the theory developed in Sections 3 
and 4. In Section 5 and 6, we use the migration load and a new, genuine multilocus, fixation 
index (-Fst)> respectively, to quantify the dependence of local adaptation and of differentiation 
on various parameters, especially, on the migration and the recombination rate. In Section 7, 
we investigate the invasion conditions for a mutant of small effect (vli) that is beneficial in 
one deme but disadvantageous in the other deme. We assume that the mutant is linked to a 
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polymorphic locus which is in selection-migration balance. We show that linkage between the 
loci facilitates invasion. Therefore, in such a scenario, clusters of locally adapted alleles are 
expected to emerge (cf. Yeaman and Whitlock 2011, Burger and Akerman 2011). In Section 
8, we study the strength of barriers to gene flow at neutral sites linked to the selected loci 
by deriving an explicit approximation for the effective migration rate at a linked neutral site. 
Our results are summarized and discussed in Section 9. Several purely technical proofs are 
relegated to the Appendix. 

2 The model 

We consider a sexually reproducing population of monoecious, diploid individuals that is 
subdivided into two demes connected by genotype-independent migration. Within each deme, 
there is random mating. We assume that two diallelic loci are under genie selection, i.e., there 
is no dominance or epistasis, and different alleles are favored in different demes. We assume 
soft selection, i.e., population regulation occurs within each deme. We ignore random genetic 
drift and mutation and employ a deterministic continuous-time model to describe evolution. 
A continuous-time model is obtained from the corresponding discrete-time model in the limit 
of weak evolutionary forces (here, selection, recombination, and migration). 

We denote the rate at which individuals in deme 1 (deme 2) are replaced by immigrants 
from the other deme by mi > (m-2 > 0). Then m = mi + ni2 is the total migration rate. 
The recombination rate between the two loci is designated by p > 0. 

Alleles at locus A are denoted by A\ and A2, at locus B by B\ and B2. We posit that A\ 
and B\ are favored in deme 1, whereas A2 and B2 are favored in deme 2. In deme k {k = 1,2), 
we assign the Malthusian parameters \ak and — \ak to A\ and A2, and \(3k and — \(3k to 
B\ and i?2- Because we assume absence of dominance and of epistasis, the resulting fitness 
matrix for the genotypes reads 







B X B X 


B1B2 


B2B2 


A X A X 


( 


at + Pk 


Oik 


oik - h 


AiA 2 









-(3 k 


A 2 A 2 


\ 


-oik + Pk 


-Oik 


-o:k ~ 13k 



By relabeling alleles, we can assume without loss of generality a\ > > 0:2 and (5\ > > 
j32- Hence, A\B\ and A2B2 may be called the locally adapted haplotypes in deme 1 and deme 
2, respectively. By relabeling loci, we can assume (3\ >u\. We define 

= aih ~ cvPi. (2.2) 

By exchanging demes, i.e., by the transformation ctk = —oik* and f3k = —(3k* (where k* denotes 
the deme 7^ k), or by exchanging loci, i.e., by the transformation = (3k an d (3k = a fc) we 
can further assume 9 > without loss of generality, cf. Appendix |A.l 
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The fitness matrix (2.1) is also obtained if the two loci contribute additively to a quan- 



titative trait that is under linear directional selection in each deme (Burger 2009c). Then 
9 = if the genotypic values are deme independent, i.e., if there is no genotype-environment 
interaction on the trait level. 

Because in the case 8 = degenerate features can occur, it will be treated separately 



(Sections 3.9 and 3.10). Therefore, unless stated otherwise, we always impose the following 
assumptions on our parameters: 



and 



and 



oli > > a 2 and ft > > ft, 



ft > ai, 



From (2.3a) and (2.3c), we infer 



6 > 0. 



ft < 012 => Oil < ft- 



(2.3a) 

(2.3b) 
(2.3c) 

(2.4) 



Therefore, locus A is under weaker selection than locus B in both demes, i.e., \a k \ < |ft| for 
k = 1,2, if and only if ft < cti holds. 

The population can be described by the gamete frequencies in each of the demes. We 
denote the frequencies of the four possible gametes A\B\, A\B%, A%Bi, and A2B2 in deme k 
by xi t k, X2,k, X3^k, and £4^. Then the state space is £4 x S4, where 
S4 = |(xi, X2, X3, X4) : Xi > and Ya=i x i = l} i s the simplex. 

The following differential equations for the evolution of gamete frequencies in deme k can 
be derived straightforwardly: 

d -Xi,k = x itk (wi,k ~ w k ) - r]ipD k + m k (xi, k * - x i>k ). (2.5) 



X i k 



dt 



Here the marginal fitness Wi tk of gamete i and the mean fitness w k in deme k are calcu- 
lated from ( |2.1[ ), T/i = 774 = —r\2 = — r/3 = 1, and D k = x\ ik x^ k — ^2,fc a; 3,fc is the linkage- 
disequilibrium (LD) measure. We note that D k > corresponds to an excess of the locally 



adapted haplotypes in deme k. The equations (2.5) also describe the dynamics of a haploid 
population if in deme k we assign the fitnesses a k , —a k , /3k, —f3 k to the alleles A\, A2, B\, 
B2, respectively. 

Instead of gamete frequencies it is often more convenient to work with allele frequencies 
and the LD measures D k . We write p k = x\ <k + X2, k and q k = xi tk + £3^ for the frequencies 
of A\ and B\ in deme k. Then the gamete frequencies calculated from the pk, qk, and 

Dk by 



x\.k = PkQk + D k , x 2 , k = p k (l - q k ) - D k , 



(2.6a) 
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X3,k = (1 ~Pk)qk ~ D k , x 4 ,fc = (1 - Qk) + D k . (2.6b) 

The constraints > and Ylt=i x i,k = 1 for i = 1,2,3,4, and k = 1,2 transform into 
< pjfc,% < 1 and -min{p fc g fc ,(l-p fc )(l-g fc )} < D k < min{p fe (l - q k ), (1 - p k )q k }. It 
follows that p k , q k , and evolve according to 

Pk = a k p k (l - p k ) + PkD k + mk{Pk* ~ Pk), (2.7a) 

qk = PkQk{^- ~ Qk) + a k D k + m k (q k * - q k ), (2.7b) 
D k = [a k (l - 2p k ) + /3 fc (l - 2 9fc ) - p] D fe 

+ "ifc [(-Dfc* - £>fc) + (Pk* - Pk){qk* - Qk)] ■ (2.7c) 

We emphasize that, because we are treating a continuous-time model, the parameters p, m k , 
a k , and (3 k are rates (of recombination, migration, growth), whence they can be arbitrarily 
large. Their magnitude is determined by the time scale. By rescaling time, for instance to 
units of p or m, the number of independent parameters could be reduced by one without 
changing the equilibrium properties. 

3 Equilibria and their stability 

We distinguish three types of equilibria: (i) monomorphic equilibria (ME), (ii) single-locus 
polymorphisms (SLPs), and (iii) full (two- locus) polymorphisms (FPs). The first two types are 
boundary equilibria, whereas FPs are internal equilibria (except when p = 0). The stability 
properties of the ME and the coordinates and conditions for admissibility of the SLPs can 
be derived explicitly. However, the stability conditions for the SLPs and the conditions for 
existence or stability of FPs could be derived only for a number of limiting cases. These 
include strong recombination, weak or no recombination, weak, strong, or highly asymmetric 
migration. 

3.1 Existence of boundary equilibria 

The four ME, corresponding to fixation of one of the gametes, exist always. Their coordinates 
are as follows: 



Mi (A 1 B 1 fixed) : 


Pk = 


= 1, 


Qk = 1, 


D k ~- 


= 


for 


k = 


= 1 


2 


M 2 {A X B 2 fixed) : 


Pk = 


= 1, 


Qk = 0, 


Dk = 


= 


for 


k = 


= 1 


2 


M 3 (A 2 B 1 fixed) : 


Pk = 


= 0, 


Qk = 1, 


Dk = 


= 


for 


k = 


= 1 


2 


M 4 {A 2 B 2 fixed) : 


Pk = 


= o, 


Qk = 0, 


D k = 


= 


for 


k = 


= 1 


2 



where a ~ signifies an equilibrium. There are up to four SLPs, one in each marginal one-locus 
system. We denote the SLPs where B\ or B 2 is fixed by Pa,i or Pa,2, respectively, and the 
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SLPs where A\ or A2 is fixed by Pb,i or Pb,2- Their coordinates and the conditions for their 
admissibility can be calculated explicitly (Eyland 1971). We define 



0fc 



and Tfc 



Pk 



By (2.3a), we have 



<7i > > ci2 and ri > > T2 . 



In addition, it is easy to show that the assumptions (2.3) imply: 



01 + 02 > 

<Tl + <T 2 < 



7~1 +T2 < 01 + 0-2, 

ri + r 2 < 0. 



If locus B is fixed (for £?i or B2), the equilibrium allele frequencies at locus A are 



1 



1 - 2ai + v 7 ! - 4ai 



0"2 



P2 



1 



1 - 20-2 - VI - 40-10-2 ) 



If locus A is fixed, the equilibrium allele frequencies at locus B are given by 



9i 



B 



1 



'l - 2ri + VI - 4rir 2 ) 



9 2 B 



1 



2 V , *z 2 

Thus, the four SLPs have the following coordinates: 



1 - 2t 2 - VI - 4rir 2 ) 



The equilibria Pa 1 and Pa, 2 are admissible if and only if 

1 01 + 0-2] < 1, 

and the equilibria Pb,i and Pb,2 are admissible if and only if 

In + T2I < l. 



(3.1) 
(3.2) 

(3.3a) 
(3.3b) 

(3.4) 

(3.5) 



Pa,i : 


PI 


— Pi 


P2 = P2, 


91 


= 92 


= 1, 


Di 


= D 2 


= 0, 


(3.6a) 


Pa,2 : 


Pi 


— Pi 


P2 = P2, 


91 


= 92 


= 0, 


Di 


= D 2 


= 0, 


(3.6b) 


P B ,i : 


Pi 


= P2 


= 1, 91 = 


9f 


92 = 




Di 


= D 2 


= 0, 


(3.6c) 


Pb,2 : 


Pi 


= P2 


= 0, gi = 


9i B 


92 = 


92 , 


Di 


= r>2 


= 0, 


(3.6d) 



(3.7) 



(3.8) 



The SLPs leave the state space through one of their 'neighboring' ME if \a\ + 02I or \ T i + T 2| 
increases above 1. In particular, we find 



01 + 02 4 -i 

01 + 02 t 1 
71 +T2 I -1 
71 + T 2 t 1 



P A ,i -> Mi and P A , 2 
P A ,i -»• M 3 and P A , 2 
Pb,i -> Mi and P B , 2 
Pb,i -»• M 2 and P B , 2 



ivi 2 , 
M 4 , 
M 3 , 

Ma. 



(3.9a) 
(3.9b) 
(3.9c) 
(3.9d) 



M 4 

Figure 1: Location of equilibria. In terms of gamete frequencies, the state space is S4 x S4, where 
each S4 corresponds to one deme. This figure shows (schematically) the location in S4 of all boundary 
equilibria and of the stable internal equilibrium F. F converges to Fqo if p — > 00 and to Fo if p — > 0. 
The LE manifold is indicated by hatching. 



Throughout, we use J, to indicated convergence from above and f to indicate convergence from 
below. Figure 1 illustrates the location of the possible equilibria. 

The SLPs are asymptotically stable within their marginal one-locus system if and only if 
they are admissible. Then they are also globally asymptotically stable within their marginal 
system (Eyland 1971). (We use globally stable in the sense that at least all trajectories from 
the interior of the designated set converge to the equilibrium.) The reader may notice that 



(3.7) and (3.8) are precisely the conditions for maintaining a protected polymorphism at locus 



A and B, respectively. 

3.2 Stability of monomorphic equilibria 

At each monomorphic equilibrium, the characteristic polynomial factors into three quadratic 
polynomials. Two of them determine stability with respect to the marginal one-locus sys- 
tems, whereas the third determines stability with respect to the interior of the state space. 
The stability properties of the monomorphic equilibria are as follows. The proof is given in 



Appendix A. 2 



Proposition 3.1. Mi is asymptotically stable if 

oi+o 2 < -1 and t\ + r 2 < -1 (3.10) 
and one of the following conditions hold 

p > min{— 02, — P2} (3.11a) 
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or 

. . f , . ("i +Pi +P + m 1 )(a 2 + /3 2 + p) cqhm 

p < mm{— «2, — P2! and rri2 > -p. . (3.11b) 

ol\ + pi + p 

M2 is always unstable. 

M3 is asymptotically stable if 

01 + o 2 > 1 and ti + r 2 < -1. (3.12) 

M4 is asymptotically stable if 

o~\ + 02 > 1 and ri + T2 > 1 (3.13) 
and one of the following conditions hold 

p>a x (3.14a) 

or 

p < ai ana ttt.2 > ^ . (3.14b) 

ai + /3i - p 



If one of the inequalities in (3.10), (3.12), or (3.13), or one of the inequalities for rri2 in 



(3.11b) or (3.14b) is reversed, the respective equilibrium is unstable. 



If we assumed 9 < 0, then M3 would always be unstable and M2 would be stable if 
Ci + o"2 < — 1 and ti + T2 > 1 . 

The above result shows that each of Mi, M3, or M4 can be stable, but never simultaneously. 
For sufficiently loose linkage, the stability of a ME is determined solely by its stability within 
the two marginal one-locus systems in which it occurs. Stability of M3 is independent of the 
recombination rate. For given migration rates, the equilibria Mi and M4 may be stable for 
high recombination rates but unstable for low ones. For a low total migration rate (mi +TO2), 
no ME is stable. For a sufficiently high total migration rate, there is a globally asymptotically 



stable ME (Section 4.5). 



3.3 Stability of single-locus polymorphisms 

As already mentioned, a single-locus polymorphism is globally attracting within its marginal 
one-locus system whenever it is admissible. Although the coordinates of the SLPs are given 
explicitly, the conditions for stability within the full, six-dimensional system on S4 x S4 are 
uninformative because the four eigenvalues that determine stability transversal to the marginal 
one-locus system are solutions of a complicated quartic equation. 

In the following we treat several limiting cases in which the conditions for stability of the 
SLPs and for existence and stability of FPs can be obtained explicitly. 
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3.4 Weak migration 



The equilibrium and stability structure for weak migration can be deduced from the model 
with no migration by perturbation theory. In the absence of migration (mi = ni2 = 0), the 
two subpopulations evolve independently. Because selection is nonepistatic and there is no 
dominance, in each deme the fittest haplotype becomes eventually fixed. In fact, mean fitness 



is nondecreasing (Ewens 1969). Our assumptions about fitness, i.e., (2.1) and (2.3a), imply 
that in deme 1 the equilibrium with pi = q\ = 1 and D\ = is globally attracting, and in 
deme 2 the equilibrium with p2 = qi = and D2 = is globally attracting. Therefore, in 
the combined system, i.e., on S4 x S4, but still with m\ = m<i = 0, the (unique) globally 
attracting equilibrium is given by 



pi = qi = 1, p 2 = <?2 = 0, D\ = D 2 = . 



(3.15) 



All other equilibria are on the boundary and unstable. 

Because, generically, all equilibria in the system without migration are hyperbolic and it 
is a gradient system (Shahshahani 1979; Burger 2000, p. 42), Theorem 5.4 in Burger (2009a) 



applies and shows that the perturbation F of the equilibrium (3.15) is globally asymptotically 



stable for sufficiently small migration rates mi and rri2- Boundary equilibria remain unstable 
for sufficiently small migration rates. It is straightforward to calculate the coordinates of the 
perturbed equilibrium to leading order in mi and m-2- They are given by 



Pi 



P2 



1 



mi 



«i + p 



ai ai + Pi + p 
ni2 p- «2 



qi 



<l2 



1 



mi 



Px+P 



P-L a\ + Pi + p 
m 2 p - P2 
-P2 p - a 2 - P2 ' 



Do 



mi 



ai + Pi + p 
m 2 

p- a 2 - P2 



(3.16a) 
(3.16b) 



— a 2 p — a 2 — P2 
Therefore, we conclude 

Proposition 3.2. For sufficiently weak migration, there is a unique, globally attracting, fully 



polymorphic equilibrium F. To leading order in mi and m-2, its coordinates are given by (3.16). 



Proposition 3.2 remains valid if the assumptions (2.3b) and (2.3c) are dropped. Apart 



from the obvious fact that migration reduces differences between subpopulations, the above 
approximations show that the lower the recombination rate, the smaller is this reduction. 
Thus, for given (small) migration rates, differentiation between subpopulations is always en- 
hanced by reduced recombination. Linkage disequilibria within subpopulations are always 
positive. 

3.5 Linkage equilibrium 

If recombination is so strong relative to selection and migration that linkage equilibrium (LE) 
can be assumed, i.e., if - max/ c= i j 2{|afc|) |/3fc|,mfc} — > 0, the dynamics (2.7) simplifies to 

Pi = ctipi(l -pi) + mi(p 2 - pi) , (3.17a) 
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P2 

qi 
92 



"2^2(1 
/9igi(l ■ 
18292(1 ■ 



-p 2 ) + m 2 (pi 

91) + "1-1(92 - 

92) + m 2 (9i - 



-P2) 
9l) 
92) 



(3.17b) 
(3.17c) 
(3.17d) 



which is defined on [0, l] 4 . 

In (3.17), the differential equations for the two loci are decoupled, i.e., (3.17a) and (3.17b) 
as well as (3.17c) and (3.17d) form closed systems. Thus, the dynamics of the full system is 
a Cartesian product of the two one-locus dynamics. Therefore, in addition to the ME and to 
the SLPs determined above, the following internal equilibrium, denoted by Fqo, may exist 



pT 



Pi j 



P2 



P 2 1 



qf, 



92 



9 2 B , 



(3.18) 



where the and q% are given by (3.4) and (3.5), respectively. No other internal equilibrium 
can exist. This equilibrium is admissible if and only if (3.7) and (3.8) are satisfied, i.e., if and 
only if all four SLPs are admissible. 

Because in the one-locus model the FP is globally asymptotically stable (hence, it attracts 
all trajectories from the interior of the state space) whenever it is admissible (Eyland 1971; 
Hadeler and Glas 1983, Theorem 2; Nagylaki and Lou 2008, Section 4.3.2), and because the 
full dynamics is the Cartesian product of the one-locus dynamics, the fully polymorphic equi- 
librium Fqo is globally asymptotically stable whenever it is admissible. Similarly, we conclude 
that a boundary equilibrium is globally asymptotically stable whenever it is asymptotically 
stable in the full system. These results in combination with those in Sections |3 . 1 1 and |3 . 2| yield 
the following proposition. 



Proposition 3.3. Assume (3.17). Then a globally asymptotically stable equilibrium exists 
always. This equilibrium is internal, hence equals Foq (3.18), if and only if (3.7) and (3.8) 
hold. It is a SLP if one of (3.7) or (3.8) is violated, and a ME if both (3.7) and (3.8) are 
violated. 

If, by variation of parameters, the internal equilibrium leaves (or enters) the state space, 
generically, it does so through one of the SLPs. The precise conditions are: 



F c 
F c 
F c 
F r 



Pa,i -<=>■ t\ +T2 4- — 1 and |<7i + cr 2 | < 1, 
Pa, 2 does not occur, 

Pb,i -<=>■ ci + cr 2 4- — 1 and |n + r 2 | < 1, 



B,2 



o~i + cr 2 f 1 and W\ + r 2 | < 1. 



(3.19a) 
(3.19b) 
(3.19c) 
(3.19d) 



When, upon leaving the state space, Fqo collides with a boundary equilibrium (SLP or ME), 
the respective boundary equilibrium becomes globally asymptotically stable. 



We note that F r 



Pa 2 does not occur because it requires t\ + r 2 f 1 arid \o\ + cr 2 1 < 



1, which is impossible by (3.3). We leave the simple determination of the conditions for 
bifurcations of Fqo with one of the ME to the interested reader. 
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Proposition |3,3| can be extended straightforwardly to an arbitrary number of loci because 
the dynamics at each locus is independent of that at the other loci. This decoupling of loci 
occurs because there is no epistasis. 

3.6 Strong recombination: quasi-linkage equilibrium 

If recombination is strong, a regular perturbation analysis of the internal equilibrium of 



(3.17) can be performed. The allele frequencies and linkage disequilibria can be calculated to 
order 1/p. Formally, we set 

m k = p k /p (A; = 1,2), (3.20) 
keep <7fc and r k constant, and let p — > oo. Then, we obtain 

Pi = Pi + 75 , (9i - Q2 ) + 0(p ) , (3.21a) 

91 = «f + ^ T2(ai " a / 2 1 ) + ; iV1 ^^ (p?° - P 2 °°) + 0(p->) , (3.21b) 

/9 V 1 - 4r lT 2 

£>l = — (p? - pf) {q? - qf) + 0(p- 2 ) , (3.21c) 
P 

and analogous formulas hold for the second deme. Because LD is of order 1/p, this approx- 
imation may be called the quasi-linkage equilibrium approximation of the fully polymorphic 
equilibrium (Kimura 1965, Turelli and Barton 1990, Nagylaki et al. 1999). We note that LD 
is positive in both demes and increases with increasing differentiation between the demes, 
increasing migration, or decreasing recombination. 

Proposition 5.1 in Burger (2009a) shows that in every small neighborhood of an equilib- 



rium of the model with LE (3.17), there is one equilibrium of the perturbed system, and 



it has the same stability properties as the unperturbed equilibrium. Because of the simple 



structure of (3.17), a stronger result can be obtained. In an isolated one-locus system on 
[0,1] 2 (e.g., (3.17a) and (3.17b[)), every trajectory from the interior converges to the unique 



asymptotically stable equilibrium (Section 3.5), and the chain-recurrent points (Conley 1978) 



are the equilibria. Therefore, the same holds for the LE dynamics (3.17), and the regular 
global perturbation result of Nagylaki et al. (1999) (the proof of their Theorem 2.3) applies 
for large p. Hence the dynamical behavior with strong recombination is qualitatively the same 
as that under LE. We conclude that for sufficiently strong recombination every asymptotically 
stable equilibrium is globally asymptotically stable. 

3.7 No recombination 

Let recombination be absent, i.e., p = 0. Then, effectively, we have a one-locus model in which 
the four alleles correspond to the four gametes A\B\, A1B2, A2B1, A^Bi- In deme k, they 
have the selection coefficients ^(a k + /3fc), \{a^ — |(— a k + /?&), — \{ctk + fik)i respectively. 
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According to Theorem 2.4 of Nagylaki and Lou (2001), generically, no more than two gametes 
can be present at an equilibrium. We will prove a stronger result and characterize all possible 
equilibria and their local stability. 

Because p = 0, there may be a polymorphic equilibrium at which only the gametes A\B\ 
and A 2 B 2 are present. We call it Fo and set 



Oik + Pk 



(k = 1,2) 



Then one- locus theory (Section 3.1) informs us that Fo is admissible if and only if 

|^i + k 2 \ < 1. 

Its coordinates are given by 



p\ 



P2 



a 
<?2 



1 - 2ki + v 7 ! - 4,k 1 k 2 ) 



1 - 2k 2 - \/l — 4kik 2 ) , 



Pk^-Pk) (fc = l,2) 



(3.22) 
(3.23) 

(3.24a) 

(3.24b) 
(3.24c) 



where 



fk 



^l,fe' ^2,k 



a0 
x 3,fc 



0, and x° A k 



1 



'\.k 



{k = 1,2). Within the subsystem 



in which only the gametes A\B\ and A 2 B 2 are present, Fo is asymptotically stable whenever 
it is admissible. One-locus theory implies that 



«1 + K 2 t 1 



Fo 
Fo 



Mi, 
M 4 . 



(3.25a) 
(3.25b) 



A simple application of Corollary 3.9 of Nagylaki and Lou (2007) shows that the gamete 
A\B 2 will always be lost (to apply their result, recall assumptions (2.3) and use 722 = 723 = 0, 

that M 2 is 



ga 



ai+Pi < < a 2 +/32 : 

always unstable. Thus, we are left with the analysis of the tri-gametic system consisting of 
A 1 B 1 , A 2 Bi, and ^2-62- (If < 0, then gamete A 2 B\ is lost.) 

In Appendix A. 3 it is proved that Fo is the only equilibrium at which both loci are poly- 
morphic except when 

m\m 2 = fh (3.26) 

holds, where 

m = -axct 2 fa.h{a\ + /9i)(«2 + h)/0 2 . (3.27) 



Ct2 



724 = 1 — 721 )• This strengthens the result in Section 



3.2 



If (3.26) holds, then there is a line of internal equilibria connecting Fo with Pai or Pb,2 ( or 
M3); see Appendix A. 3 



We find that Fo is asymptotically stable if 

m\m 2 < fh, 



(3.28) 
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and unstable if the inequality is reversed (Appendix A.4). For sufficiently small migration 
rates, Proposition |3.2| implies that Fq = F and Fq is globally asymptotically stable. If the 



inequality in (3.28) is reversed, Fq may or may not be admissible. 



Of course, if Fq is asymptotically stable, then the equilibria Mi and M4 are unstable; cf. 



(3.25). The following argument shows that M3 cannot be simultaneously stable with Fo- We 

aia 2 /3i{3 2 o-\g 2 t\t 2 



rewrite (3.28) as 



Kl«2 > 



2 



(C1T2 - &2T1] 



Because 



cr. 



+ t7 



(3.29) 



(3.30) 



(3.29) becomes 



(CJ1T2 - a 2 T 1 ) 2 + (0-1 + n)(a 2 + r 2 ) < . (3.31) 
Since M3 is asymptotically stable if ( |3.12| ) holds and because, as is easy to show, (3.12) and 



(3.31) are incompatible, the assertion follows. It can also be shown from (3.12) and (3.31) 



that M3 cannot become stable when Fo loses its stability except in the degenerate case when 
o~\ + 02 = 1 and n + r 2 = -1. 

In our tri-gametic system, Pa,i and Pb,2 ar e the only possible SLPs. They may exist 



simultaneously with Fq if (3.28) holds, i.e., if Fq is stable, but not otherwise (Appendix A. 5) 



If (3.28) holds, both are unstable (if admissible). Pa,i or Pb,2 have an eigenvalue if and only 
if (3.26) holds or if they leave or enter the state space through a ME. In Appendix A. 5 it is 



shown that Pa 1 is asymptotically stable if and only if 

t\ + T 2 < —1 and \a\ + o~ 2 \ < 1 and m\m 2 > rh, 
and Pb,2 is asymptotically stable if and only if 

1 < o\ + o 2 and \t\ + r 2 \ < 1 and m\m 2 > rh. 



(3.32) 



(3.33) 



Hence, if m\m 2 increases above rh, the SLP that is admissible becomes asymptotically stable. 
Upon collision of the stable SLP with one of the adjacent ME, the corresponding ME becomes 
stable and remains so for all higher migration rates. We summarize these findings as follows: 



Proposition 3.4. Except in the degenerate case when (3.26) holds, only equilibria with at 



most two gametes present exist. If (3.23) is satisfied, the equilibrium Fq given by (3.24) is 



admissible. If, in addition, (3.28) is fulfilled, then Fq is asymptotically stable. For sufficiently 



small migration rates, it is globally asymptotically stable. If Fo is unstable or not admissible, 
then one of the ME (Mi, M3, M4) or one of the SLPs (Pa,i> Pb,2) is asymptotically stable. If 



(3.26) holds, then there is a line of equilibria with three gametes present. 
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The proposition shows that, except for the nongeneric case when (3.26) holds, there is 
always precisely one stable equilibrium point. Numerical results support the conjecture that 
the stable equilibrium is globally asymptotically stable. Bifurcation patterns as functions of 
m are derived in Section 14.81 

In addition to Fo, there exists a second FP on the edge connecting M2 and M3. Although 
its coordinates can be calculated easily, it is not of interest here as it is unstable for every 
choice of selection and migration parameters. This unstable equilibrium leaves the state space 
under small perturbations, i.e., if p > 0. 

3.8 Highly asymmetric migration 

All special cases treated above suggest that there always exists a globally asymptotically stable 
equilibrium. This, however, is generally not true as was demonstrated by the analysis of the 
two-locus continent-island (CI) model in Burger and Akerman (2011). There, all possible 
bifurcation patterns were derived and it was shown that the fully polymorphic equilibrium 
can be simultaneously stable with a boundary equilibrium. For highly asymmetric migration 
rates, the equilibrium and stability structure can be obtained by a perturbation analysis of 
this CI model. 

Therefore, we first summarize the most relevant features of the analysis in Burger and 
Akerman (2011). Because in that analysis the haplotype A2B2 is fixed on the continent (here, 
deme 2) and there is no back migration (m.2 = 0), it is sufficient to treat the dynamics on the 
island (here, deme 1) where immigration of A2B2 occurs at rate m\. Thus, the state space is 

It was shown that up to two internal (fully polymorphic) equilibria, denoted by E+ and 
E_, may exist. Only one (E + ) can be stable. Two SLPs, Ea and Eb, may exist. At Ea, locus 
A is polymorphic and allele B2 is fixed; at Eb, locus B is polymorphic and allele A2 is fixed. 
Ea (Eb) is admissible if and only if mi < a\ (mi < /3i). Ea is always unstable. Finally, there 
always exists the monomorphic equilibrium Ec at which the haplotype A2B2 is fixed on the 
island. The equilibrium coordinates of all equilibria were obtained explicitly. In addition, it 
was proved (see also Bank et al. 2012, Supporting Information, Theorem S.4) that precisely 
the following two types of bifurcation patterns can occur: 

Type 1. There exists a critical migration rate m* > such that: 

• If < mi < m ', a unique internal equilibrium, E+, exists. It is asymptotically stable 
and, presumably, globally asymptotically stable. 

• At mi = m ', E_|_ leaves the state space through a boundary equilibrium (Eb or Ec) by 
an exchange-of-stability bifurcation. 

• If mi > m*, a boundary equilibrium (Eb or Ec) is asymptotically stable and, presumably, 
globally stable. 
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Type 2. There exist critical migration rates m° and m* satisfying m* > m° > such that: 

• If < mi < m ° ; there is a unique internal equilibrium (E+). It is asymptotically stable 
and, presumably, globally stable. 

• At mi = m °, an unstable equilibrium (E_) enters the state space by an exchange-of- 
stability bifurcation with a boundary equilibrium (Eb or Ec). 

• If 777° < m\ < 777*, there are two internal equilibria, one asymptotically stable (E + ), the 
other unstable (E_), and one of the boundary equilibria (Eb or Ec) is asymptotically 
stable. 

• At mi = "rn*, the two internal equilibria merge and annihilate each other by a saddle- 
node bifurcation. 

• If mi > m ', a boundary equilibrium (Eb or Ec) is asymptotically stable and, presumably, 
globally stable. 

For sufficiently large migration rates (m > m" > m"), Ec is globally asymptotically 
stable in both cases. Bifurcation patterns of Type 2 occur only if the recombination rate is 
intermediate, i.e., if p is about as large as at\. 



By imbedding the CI model into the two-deme dynamics, (2.5) or (2.7), perturbation 
theory can be applied to obtain analogous results for highly asymmetric migration, i.e., for 
sufficiently small 7772/7771 (Karlin and McGregor 1972). This is so because all equilibria in the 
CI model are hyperbolic except when collisions between equilibria occur (Burger and Akerman 
2011). Since the coordinates of the internal equilibria E + and E_ were derived, the perturbed 
equilibrium frequencies can be obtained. Because they are too complicated to be informative, 
we do not present them. The perturbation of E+, denoted by F, is asymptotically stable. As 
E is internal, it cannot be lost by a small perturbation. Also the boundary equilibria and 
their stability properties are preserved under small perturbations. In particular, Ec gives rise 
to M4, and the SLPs Ea and Eb give rise to Pa,2 an d Pb,2> respectively, 

If recombination is intermediate, (at least) under highly asymmetric two-way migration, 
one stable and one unstable FP can coexist. In this case the stable FP, F, is simultaneously 
stable with either M4 or Pb,2- Although there is precisely one (perturbed) equilibrium in 
a small neighborhood of every equilibrium of the CI model, we can not exclude that other 
internal equilibria or limit sets are generated by perturbation. 

3.9 The case 6 = 



The analyses in the previous sections are based on the assumptions (2.3), in particular, on 
9 > 0. However, many of the results obtained above remain valid if 9 = 0. Here, we point out 
the necessary adjustments. 
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Without loss of generality, we can assume 



Wk\ < \Pk\ for k = 1,2 



(3.34) 



in addition to = and (2.3a). Then we observe that 

02 



02 



0"i + (72 = — (ri + r 2 ) > 7i + r 2 and ki + k 2 = 

a 2 «2 + P2 



n + T2) < T\ + r 2 . 



Therefore, either 



< K\ + «2 < Tl + T 2 < (Tl + <7 2 



(3.35) 



(3.36a) 



or 



> K\ + /t 2 > Tl + r 2 > CJl + (T 2 



(3.36b) 



or 



Ki + k 2 = Ti + r 2 = (Ti + cr 2 = 



(3.36c) 



applies, where equality in (3.36a) and (3.36b) holds if au = Pk (k = 1,2). In addition, 



Kl + K2 = 



Tl + T 2 = 



0"! + <T 2 = 0. 



(3.37) 



With these preliminaries, we can treat the changes required in the above propositions if 
= 0. 



From (3.36) we infer that, in Proposition 3.1, not only M 2 but also M3 is always unstable. 



In addition, if > n + r 2 > o\ + 02, then Mi is asymptotically stable for sufficiently strong 
migration, whereas M4 is stable for sufficiently strong migration if < t\ +T2 < o\ +o"2 holds. 



As already noted, Proposition 3.2 remains valid independently of the value of 9. 

In Proposition 3.3, the only SLPs through which the internal equilibrium can leave 



the state space are Pb 1 and Pe2i see (3.19c) and (3.19d). The reason is that, except when 



Ci + °2 = (and ( |3.37 ) applies), Pa,i and Pa,2 are only admissible if Pb,i and Pb,2 are. Thus, 
the locus under weaker selection always becomes monomorphic at lower rates of gene flow 
than the locus under stronger selection. 

If p = (Proposition 3.4), Fo is asymptotically stable whenever it is admissible because 
rh — > 00 as 9 — > 0; see (3.28). In addition, (3.36) implies that Fq persists stronger gene flow 



than the SLPs, which are always unstable; see (3.32) and (3.33) 



In the highly symmetric case of (3.36c), SLPs cannot be lost. Thus, Fqo is always admissible 



and globally stable, cf. Proposition 3.3 If p = 0, (3.37) implies that Fq exists always (and 



is stable). In the next section we show that in this highly symmetric case the FP is always 
admissible for arbitrary recombination rates. 
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3.10 The super-symmetric case 



In many, especially ecological, applications highly symmetric migration-selection models are 
studied. Frequently made assumptions are that the migration rates between the demes are 
identical (mi = ITI2), selection in deme 2 mirrors that in deme 1 = — a^*), and the loci 
are equivalent (a& = (3k). Thus, 9 = and (3.36c) holds, which we assume now. 



Conditions (3.7) and (3.8) imply that all four SLPs are admissible. Hence, all monomor- 



phisms are unstable. In addition, it can be proved that all SLPs are unstable (Appendix A.6). 
If migration is weak, a globally asymptotically stable, fully polymorphic equilibrium (F) exists 



(Proposition 3.2). 

Because every boundary equilibrium is hyperbolic for every parameter choice, the index 
theorem of Hofbauer (1990) can be applied. Since none of the boundary equilibria is satu- 
rated, it follows that an internal equilibrium with index 1 exists. For small migration rates, 
this is F because it is unique. Since the boundary equilibria are always hyperbolic, no internal 
equilibrium can leave the state space through the boundary. However, we cannot exclude 
that the internal equilibrium undergoes a pitchfork or a Hopf bifurcation. Numerical results 
support the conjecture that the internal equilibrium is unique and globally attracting, inde- 
pendently of the strength of migration. This is a very special feature of this super-symmetric 



case; cf. Proposition 4.3 



3.11 General case 

Because a satisfactory analysis for general parameter choices seems out of reach, we performed 
extensive numerical work to determine the possible equilibrium structures. In no case did we 
find more complicated equilibrium structures than indicated above, i.e., apparently there are 
never more than two internal equilibria. If there is one internal equilibrium, it appears to 
be globally asymptotically stable. If there are two internal equilibria, then one is unstable 
and the other is simultaneously stable with one boundary equilibrium (as in the CI model). 
Apparently, two internal equilibria occur only for sufficiently asymmetric migration rates and 
only if the recombination rate is of similar magnitude as the selective coefficients. 



A glance at the dynamical equations (2.7) reveals that an internal equilibrium can be in 
LE only if p\ = P2 or qi = q2- From (3.18), (3.4) and (3.5), we find that this can occur only 
if |cri + 02I = 1 or \ T i + T"2 1 = 1, i.e., for a boundary equilibrium. Thus, internal equilibria 
always exhibit LD. 

For low migration rates as well as for high recombination rates, there is a unique, fully 
polymorphic equilibrium which is globally asymptotically stable and exhibits positive LD 
(Sections 3.4 or 3.6). We denote the (presumably unique) asymptotically stable, fully poly- 



morphic equilibrium by F. If migration is weak, or recombination is weak, or recombination 
is strong, we have proved that F is unique. Useful approximations are available for weak mi- 
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gration or strong recombination; see (3.16) or (3.21). Finally, for sufficiently high migration 
rates one of the monomorphic equilibria is globally asymptotically stable. 



4 Bifurcation patterns and maintenance of polymorphism 

Here we study how genetic variation and polymorphism depend on the strength and pattern 
of migration. In particular, we are interested in determining how the maximum migration 
rate that permits genetic polymorphism depends on the other parameters. For this end, we 
explore properties of our model, such as the possible bifurcation patterns, as functions of the 
total migration rate m. We do this by assuming that a\, 02, Pi, P2 , P, and the migration 
ratio 

*=^, (4-1) 
m 

where m > and < <f> < 1, are constant. The values = and <p = 1 correspond to 
one-way migration, as in the CI model. If <j) = ry, migration between the demes is symmetric, 
an assumption made in many studies of migration-selection models. Fixing (j> and treating m 
as the only migration parameter corresponds to the migration scheme introduced by Deakin 
(1966). 

4.1 Important quantities 

We define several important quantities that will be needed to describe our results and sum- 
marize the relevant relations between them. Let 



TAB 



-AB 



,M 4 



IM 4 



011 — 0.2' 

Pi 
P1-P2 

ai + Pi 
ai+Pi- (a 2 + /3 2 )' 

aiPi(a2 - P2) 

aipi(ct2 - P2) - "2/32(01 - Pi) ' 

aiPi(a2 + P2) 

aiPi(a 2 + P2) - a 2 p 2 (a 1 + Pi) ' 

ai(P2 + p)(ai+ Pi+ p) 

ai(/?2 + p)(ai +Pi+p)- a 2 (Pi + p)(a 2 + P2 + p) ' 

Pija-2 + p)(ai + Pi+ p) 

Pi(a 2 + p)(a 1 +Pi+p)- P 2 {ai + p)(cx 2 + P2+ p) 

Pi{ot2 ~ p){ai + Pi ~ P) 

Pi{a 2 - p)(a 1 + Pi- p) - p 2 (ai - p)(a 2 + P 2 - p)' 

«i(/?2 ~ p){ai + Pi ~ P) 

oti{P 2 - p)(ai + Pi - p) - a 2 (Pi - p)(a 2 + P 2 - p)' 



(4.2a) 
(4.2b) 
(4.2c) 
(4.2d) 
(4.2e) 
(4.2f) 
(4.2g) 
(4.2h) 
(4.2i) 
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,AF _ aijai + Pi){2a>2 + f3 2 ) 



(4-2j) 



ai(ai + /3i)(2a 2 + /3 2 ) - a 2 {a 2 + /3 2 )(2ai + fc) 

(4.2k) 



,bf _ M«l + /3l)(Q2 + 2/3 2 ) 



Pl(«i + p\)(a 2 + W2) - h{a 2 + /3 2 )(ai + 2p\) ' 



and 



- A = V ( 4 - 3a ) 

Ql — 0(d!l — OL 2 ) 

B A ^2 /, o, s 

m = a loT. 4 - 3b 

m F = (ai+/3i)(a 2 + /3 2 ) 

ai + Pi - <A(«i + A - a 2 - /? 2 ) ' 
mMl = -(a 1+ p 1+P )(a 2 + p 2 + P ) 

a\ + Pi + P - <p(ai + pi - a 2 - p 2 ) 
m M 4 = (ai + /3i-p)(a 2 + /3 2 -p) 

ai + Pi - P - <M«i + A - «2 - /3 2 ) ' 

1 /-aia 2 /?i/3 2 (ai + /3i)(a 2 + /3 2 ) 

m= «V «w> ■ (43f) 

We set m A = 00, m B = 00, and m F ° = 00 if </> = A , = 4> B , and = F °, respectively. 
Similarly, we set m* = 00 if = 0, <j> = 0, or cj) = 1. 

The quantities m A , m B , and m F ° yield the bounds for the intervals of total migration 
rates m in which the SLPs at A, B, and the polymorphic equilibrium Fo, respectively, are 
admissible: 

m 

-\<ai + a 2 <\ <=^ -1 < —r < 1, (4.4a) 

m A 

m 

-1< n + r 2 < 1 -1< — =r < 1, (4.4b) 

Tfl 

-1<K1 + K 2 <1 <^> -1 < — f- < 1. (4.4c) 
Here, the left and the right inequalities correspond, and we have 

m A > > </> A , (4.5a) 



m B > <^> ^ > B , (4.5b) 
m F o > (f)Xf) fo . (4.5c) 



From (2.3), we obtain 



m A / 0, m B / 0, m F ° / 0, m* > 0, (4.6) 
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a 2 < m A < ax, fa < m B < fa, a 2 + fa< m F ° <a x + fa 



(4.7) 



The quantities m Ml and m Mi occur in the stability conditions of the monomorphic equi- 



,M 



libria Mi and M4 (Proposition 4.1), and m* determines the range of stability of Fo; see (4.56) 
They satisfy 



-(«! + fa + p) < m Ml < -(a a + fa + p), a 2 + fa ~ P < ™ 4 < «i + Pi - p. (4.8) 

We note that m A , m B , m Fo , and m M4 assume their minima if (ft = and their maxima if 
= 1, whereas m Ml assumes its minimum or maximum at (ft = 1 or (ft = 0, respectively, m* 
is a convex function of (ft, and symmetric around its minimum (ft = 1/2. 

The definitions of (several of) the quantities (ft* are motivated by the following relations: 



where we have 



m 



m 

m k - 
Mi _ 



in 



-Mi 



m 



M 4 



rn 



m 
Fo 



M 4 



-m 



in 



-in 



-in 



-in 



in 



in 



-in 



in 



l AB and m A < 0, 



i, AB 



The following relations apply to in*: 

A _ 



-m 



-m 



in 



Mi 



— m 



m 

B . 



Fn * 

m " = m 



-in 



Fo 



m 



and m A > 0, 
and ?n A < 0, 



l Ml and m B < 0, 
l Mi and m A > 0, 
b Mi and m B > 0, 
6 BFo and m B < 0, 
b AF ° and m A > 0, 



p = 0. 

= AB , 
= M4 , 



(4.9a) 
(4.9b) 
(4.9c) 
(4.9d) 
(4.9e) 
(4.9f) 
(4.9g) 
(4.9h) 

(4.10) 

(4.11a) 
(4.11b) 
(4.11c) 



where we derived (4.11b) and (4.11c) from (4.9c) and (4.9f) using (4.10) 



In the following, we summarize the most important inequalities between the quantities X : 



< 



t> A < 6 AF " < 6 AB < 6 BFo < 



< 1, 



(4.12) 



fa < «2 



< 6™ < 



AB , iA 



b AFo < 6 Fo < 6 BFo . 



(4.13) 
(4.14) 
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They can be derived straightforwardly from their definitions and our general assumption (2.3). 
Finally, if p = and 6 = a\a 2 — the following relations hold: 



< 
< 



1 < 
1 < 



< 



< 



< 



(,AF 



< 



< 



/AB 



<,BF < 
;,BFo < 



< 



< 



4 < 1 
4 < 1 



< 0, 
> 0, 



and 



TAB 



< 



1M1 



if p 2 < «2- 



(4.15a) 
(4.15b) 

(4.15c) 



Additional relations that are needed only in the proofs may be found in Appendix |A.7| 
4.2 Admissibility of SLPs 

We begin by expressing the conditions for admissibility of the SLPs in terms of the total 
migration rate m and the migration ratio (j>. Since, by (3.7), (3.8), and (4.4), every SLP is 
admissible if m is sufficiently small and leaves the state space at a uniquely defined critical 
migration rate, it is sufficient to determine this critical rate and the monomorphism through 
which it leaves the state space. Using (4.3a), (4.3b), (4.5), and (4.4), we infer from (3.9) that 



< 
> 
< 
> 



6 and m f — m 
f) A and m f m A 



and m f 



-m 

,B 



Pa,i 
Pa,i 
Pb,i 
Pb,i 



Mi and P A ,2 
M 3 and P A , 2 
Mi and P B ,2 
M 2 and P B , 2 



M 2 , 
M 4 , 
M 3 , 
M 4 . 



(4.16a) 
(4.16b) 
(4.16c) 
(4.16d) 



and m f m 
In particular, no SLP is admissible if 

m > max{|m A |, |m B |}. (4-17) 
We observe that locus A is polymorphic and locus B is monomorphic if and only if 



m 



B 



< m < m 



If /3 2 < a 2 , we infer from (|A.18c|) and (|A.18d) that (|4.18|) holds if and only if 

< 6 < 



TAB 



/.AB 



(4.18) 



(4-19) 



Therefore, (2.4) implies that if locus A is under weaker selection than locus B in both demes 
(|/3fc| > \ak\), then there is a range of values 4> and m such that locus A is polymorphic whereas 
B is monomorphic. This is in contrast to the CI model or highly asymmetric migration rates 
or 9 = 0, where it is always the locus under weaker selection that first loses its polymorphism 
while m increases. This is a pure one- locus result and a consequence of the classical condition 



for a protected polymorphism, e.g., (3.7). With two-way migration, a locus with alleles of 
small and similar (absolute) effects in the demes («i ~ —a 2 ) may be maintained polymorphic 
for higher migration rates than a locus with alleles of large and very different (absolute) effects. 
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4.3 Stability of monomorphic equilibria 



Here, we reformulate the stability conditions of the ME derived in Section 3.2 in terms of m 
and (ft. 



Proposition 4.1. Mi is asymptotically stable if 

(ft < <fi A and m > max{— m A , — m B , m Ml }. 

M2 is always unstable. 

M3 is asymptotically stable if 

4> k < (ft < 4> B and m > max{m A , — m B }. 

M4 is asymptotically stable if 

<f> > (f) B and m > max{m A ,m B ,m M4 }. 



(4.20) 



(4.21) 



(4.22) 



// in these conditions one inequality is reversed, the corresponding equilibrium is unstable. 



Proof. We prove only that the statement about Mi is equivalent to that in Proposition 3.1 
The others follow analogously or are immediate. 

From Proposition 3.1 and (4.3a), (4.3b), (4.3d), and (4.4), we infer immediately that Mi 
is asymptotically stable if and only if 



m , m 
1 < r and 1 < E 



and 



-77T 



m > m 



-m'- 



(4.23) 
(4.24) 



The possible inequalities between —m , — m , and m 1 are given in (A. 32) and (A. 33). By 
d4.5a| ), Q4.5bD , and ( |4.12[ ), it follows that ( |4.23| ) is feasible if and only if < cf) A . Thus if 
<p > <p A , Mi is unstable. Therefore, (|4.23|) and (14.241) are equivalent to (14.201). □ 



Remark 4.2. (i) We have max{— m A , — m B , m Ml } = m Ml in (4.20) if and only if 

(ft < min{0 Ml , (ft Ml } and p < —a.2 and $2 < «2> or 
< (ft Ml and p < — /?2 and /?2 > «2- 

(ii) We have max{m A , m B , m M4 } = m M4 in (4.22) if and only if 

(ft > (ft M4 and p < a\. 



(4.25a) 
(4.25b) 



(4.26) 



(iii) An internal equilibrium in LD can leave or enter the state space through Mi or M4 only 
if m = m Ml or m = m M4 , respectively. If (4.25) or (4.26) holds, then Mi or M4, respectively, 
become asymptotically stable by the bifurcation. 
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Proof of Remark \4.£\ If f3 2 > a 2, statement (i) is an immediate consequence of (A. 32a) and 



(A. 32b) because cj) < (j) A implies < min{- 



-m 



-m B }. If /3 2 < a 2 , then (A.32a), (A. 32b), and 



( |A,32c ) show that max{— m A , 
or (b) p < p Ml and (j) < <f> AB 



-m B ,m 



Mi 



} = m M i if ( a ) p < p Ml (A.23) and AB < (j)< 



or 



JMi 



< p < —a 2 and 4> < </> Ml > where p Ml < —a 2 by 



Mi 



( |A,26a ). Invoking (A. 31), we can combine conditions (a), (b), and (c) to obtain (4.25a). 



Statement (ii) follows directly from (A.18f) and (A.35a). 

Statement (hi) follows by observing that only internal equilibria in LD will depend on p, 



the factor ts (A.4) in the characteristic polynomial at Mi is the only one that depends on p, 
and £3 gives rise to an eigenvalue zero if and only if m = m 1 . An analogous argument holds 



for M 



□ 



The asymmetry between (4.25) and (4.26) results from the fact that a\ < Pi is assumed, 



whereas f3 2 < a 2 or /3 2 > a 2 is possible. The reader may recall the comments made below 
Proposition |3.1| In addition, we note that if the fitness parameters and p and <j> are fixed, a 
stable ME remains stable if m is increased. This is not necessarily so if m and <f> are varied 
simultaneously. For related phenomena in the one-locus case, see Karlin (1982) and Nagylaki 



(2012). In Section 4.5 we will prove global convergence to one of the asymptotically stable 



ME if m is sufficiently large. 



4.4 Weak migration 



We recall from Proposition (3.2) that for sufficiently weak migration, there is a fully poly- 



morphic equilibrium, it is globally asymptotically stable, and exhibits positive LD in both 
demes. 



4.5 Strong migration 

Proposition 4.3. For sufficiently large m, one of the monomorphic equilibria Mi, M3, or M4 



is globally attracting. This equilibrium is M\, M3, or M4 if 1 
respectively. 



< 



< < 



\ or (j) B < 



Proof. The proof is based on the perturbation results about the strong-migration limit in Sec- 
tion 4.2 of Burger (2009a). The strong-migration limit is obtained if maxfc = i i 2{|afe|, \/3k\, p}/m 
— > 0. In this limit, the demes become homogeneous and the system of differential equations 



(2.7) converges to a system, where in each deme 



p = ap(l -p) + (3D, 
q = Pq{l - q) + aD, 
D = [a(l - 2p) + (8(1 - 2q) - p]D 



(4.27a) 
(4.27b) 
(4.27c) 
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holds with pi = p2 = p, qi = qi = q, D\ = D<i = D. Here, 



a 



(1 — 4>)a.\ + <poi2 and j3 = (1 — <fi)f}\ + 



(4.28) 



are the spatially averaged selection coefficients and averaging is performed with respect to 
the Perron- Frobenius eigenvector (l — (j),(f)) of the migration matrix (see Section 4.2 in Burger 
(2009a) for a much more general treatment starting with a multilocus model in discrete time). 
Therefore, Proposition 4.10 in Burger (2009a) applies and, provided m is sufficiently large, 



all trajectories of (2.7) converge to a manifold on which the allele frequencies and the linkage 



disequilibria in both demes are nearly identical. In addition, in the neighborhood of each 



hyperbolic equilibrium of (4.27) there is exactly one equilibrium of (2.7), and it has the same 
stability. 

In the present case, the conclusion of Proposition 4.10 in Burger (2009a) can be consid- 



erably strengthened. Because the system (4.27) describes evolution in an ordinary two-locus 



model under genie selection, the ME representing the gamete of highest fitness is globally 



asymptotically stable. In fact, (4.27) is also a generalized gradient system for which Lemma 



2.2 of Nagylaki et al. (1999) holds. Therefore, the analog of statement (c) in Theorem 4.3 of 
Burger (2009a) applies and yields global convergence to the unique stable equilibrium. 

Finally, it is an easy exercise to show that, in the strong-migration limit, i.e., with fitnesses 
averaged according to (4.28), gamete A\B\, A2B1, or A2B2 has highest fitness if <fi < A , 



< < 



or 



> 



, respectively. Since there is no dominance, the corresponding ME is 
the unique stable equilibrium. □ 

4.6 Linkage equilibrium 

We shall establish all possible equilibrium configurations and their dependence on the pa- 
rameters under LE. In Figure 2, the equilibrium configurations are displayed as schematic 
bifurcation diagrams with the total migration rate m as the bifurcation parameter. In Theo- 
rem 



4.4, we assign to each diagram its pertinent parameter combinations. 



In order to have only one bifurcation diagram covering cases that can be obtained from 
each other by simple symmetry considerations but are structurally equivalent otherwise, we 
use the sub- and superscripts X and Y in the labels of Figure 2. For an efficient presentation 
of the results, we define 



Px 



B,l, 



A,l: 



M; 



Mi, rrf 



m B , rn' 



-m 



(LI) 



Px = Pa,i, Py = Pb,i, Mi = Mi, m A = -m A , m Y = -m B , 



(L2) 



Px = Pa,i. p Y = Pb,2, Mi = M 3 , m x = m A , m Y = -m B , 



(L3) 
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a 




"' Py 



b 




Figure 2: Bifurcation diagrams for LE. Diagrams (a)-(c) display the equilibrium configurations listed 
in Theorem |4.4| Each line indicates one admissible equilibrium as a function of the total migration rate 
Til. Only equilibria are shown that can be stable or are involved in a bifurcation with an equilibrium that 
can be stable. Lines are drawn such that intersections occur if and only if the corresponding equilibria 
collide. Solid lines represent asymptotically stable equilibria, dashed lines unstable equilibria. The 



meaning of the superscripts X and Y is given in (LI I - (L5) 



Px = Pb,2, Py = Pa,i. M i = M 3, ™> 



R Y A 

-m , m = m , 



(L4) 



Px = Pb,2, Py = Pa,2, M, = M 4 , m X = m B , m Y = m A . 



(L5) 



Theorem 4.4. Assume LE, i.e., (3.17). Figure 2 shows all possible bifurcation diagrams that 



involve bifurcations with equilibria that can be stable for some m given the other parameters. 
A . Diagram (a) in Figure 2 occurs generically. It occurs if and only if one of the following 
cases applies: 

(4.29) 



< (f) AB and p2 < ci2 and (LI) 



or 



4> AB < <j) < (p R and j3 2 < «2 and (|L2 ) 



(4.30) 
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Figure 3: Order in which the bifurcation diagrams of Figure 2 occur as <j> increases from to 1. 



or 



ar- 



m- 



or 



< cf> and 0£2 < P2 and (L2) 



< <f> < (f) AB and flL3b 



<AB 



< (fx ^ and (L4) 



< <fi and (L5). 



(4.31) 
(4.32) 
(4.33) 
(4.34) 



B. The following two diagrams occur only if the parameters satisfy particular relations. 
Diagram (b) in Figure 2 applies if one of the following two cases holds: 



TAB 



and @2 < 012 and (LI) 



or 



-AB 



and (L4). 



Diagram (c) in Figure 2 applies if one of the following two cases holds: 



b A and Px = Pa i and m Y 



-m 



or 



and Px = Pb 2 an d m = m . 



(4.35) 



(4.36) 



(4.37) 



(4.38) 



C. Figure 3 shows the order in which the bifurcation diagrams of Figure 2 arise if (p is increased 
from to 1. 

Proof. We prove parts A and B simultaneously, essentially by rewriting the conditions in 
Proposition 3.3 on admissibility and stability of the equilibria in terms of m, m A , and m B 



(4.3). 



From (3.19) and (4.4), we infer easily: 

Foo -> Pa,i m t -m B and < -m B < \m A \ 



(4.39a) 
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oo 


v D 
► Pa.2 


does not occur, 




oo 


► Pb,i 


<J=^ m f — m A and < — m A < — m B , 


(4.39c) 


oo 


> P B ,2 


m t m - A and < m A < |m |, 


(4.39d) 


Foo 


-»■ Mi 


<S=> m t — m A = — m B and < — m A = — m B , 


(4.39e) 


Foo 


-> M 3 


•S=>- m t m - A = ~Tn B and < m A = — m B , 


(4.39f) 


Foo 


-»■ M 2 


or Fqo —> M4 do not occur. 


(4.39g) 



Invoking the relations (A. 18), we can rewrite conditions (4.39a), (4.39c )-(4.39f) in the form 
Foe -»• Pa,i <= 



AB < 4> < <P AB if p 2 < a 2 , 



Pb,i 

Pb,2 

Mi 
M 3 



m t ~ m an< i either 
< AB if a 2 < /3 2 or < 
m t -"i A and /3 2 < a 2 and <f> < AB 
m t m A and > AB , 



m f — JTi 

. A 

mjm - 



—m and /3 2 < a 2 and 
-m B and <b 



TAB 



iAB 



(4.40a) 
(4.40b) 
(4.40c) 
(4.40d) 
(4.40e) 



We conclude immediately that (4.40b) applies in case (4.29) (Part A), (4.40d) in case (4.35) 
(Part B), and ( |4.40e[ ) in case Q4.36| ) (Part B). From \A.\2\ and ( |4.13[ ) we conclude that ( |4.40a[ ) 
applies in the following cases: (4.30)-(4.32) (Part A), or (4.37) (Part B). Analogously we 
conclude that (4.40c) applies in the following cases: (4.33), (4.34) (Part A), or (4.38) (Part 
B). 



From Proposition 3.3 and (4.16) we obtain: 



B 1 A 1 

-m < m < \m 



A B 

—m < m < —m , 

A 1 B 1 

m < m < \m \. 



(4.41a) 
(4.41b) 
(4.41c) 



Pa,i is globally asymptotically stable <;= 
Pb,i is globally asymptotically stable 
Pb,2 is globally asymptotically stable <^ 

As m — > max{|m A |, |w, B |}, the stable SLP leaves the state space according to ( 4.16[ ), which 
gives precisely the cases corresponding to diagrams (a) and (c). If <f> = (j) A (m A = 00), Pa,i is 
always admissible, cf. (4.37). If 4> = <j) B (m B = 00), Pb,2 is always admissible, cf. ( |4.38| ). 
A ME is globally asymptotically stable and only if 

m > max{|m A |, |w. B |}. 

this equilibrium is Mi if 



(4.42) 



By Proposition 
(14351)), or M 3 if 



4.1 



and Remark 



4.2 



< 



(cases (4.29)-(4.31), 



< < 



cases (4.32), (4.33), (4.36)), or M 4 if ^ < (4.34). 



□ 



The bifurcations of equilibria that cannot be stable can be derived easily from Sections 4.2 



and 4.3 and the above theorem by noting that these are boundary equilibria and corresponding 
pairs of SLPs are admissible for the same parameters; see (3.7) and (3.8). Inclusion of these 
bifurcations would require the introduction of subcases. 
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Corollary 4.5. Under the assumption of LE, the maximum migration rate, below which a 
stable two-locus polymorphism exists, is given by 



m max = min{|m A |, |m B |}. 



(4.43) 



The corollary is a simple consequence of Proposition 3.3 and (4.40) 



4.7 Strong recombination: quasi-linkage equilibrium 

We recall from Section |3.6| that for sufficiently strong recombination, global convergence to 



the unique stable equilibrium occurs. From the coordinates (3.21) of the perturbed internal 



equilibrium, which is in quasi-linkage equilibrium, approximations could be derived for the 
critical migration rates at which the internal equilibrium collides with a boundary equilibrium 
and leaves the state space. It is not difficult to check with Mathematica that for large p, F 
collides with Pb,2 if m = m, max (PB,2) + 0(p~ 2 ), where 



B,2y 



m 



(m A ) 3 
P 



—i 

«2 



^_ 1^ 
Pi fa 



40(1 - , 



We note that m ma x(PB,2) > if and only if 



> 



k AB 



(4.44) 

as is expected from (4.40c). Closer 



examination of (4.44) reveals that both mmax(PB,2) > m ^ an d m ma x(PB,2) < mA may hold. 



Thus, the fully polymorphic equilibrium may be maintained for higher or lower migration 
rates than in the case of LE. This does not conform with the intuitive expectation that 



for reduced recombination, m 



p ( 

max V 



B,2j 



> mt 



should hold because the locally adapted 



haplotypes (A^Bk in deme k) are less frequently broken apart. However, numerical evaluation 
of (4.44) shows that m max (PB,2) < m max occurs only for about 3% of the admissible parameter 
combinations and if it holds, m max (PB,2) is only very slightly less than m^ax (results not 
shown). If p is about as large as the largest selection coefficient or smaller, m max increases 



with decreasing p. Expressions analogous to (4.44) can be obtained for collisions of F with 
the other equilibria. 



4.8 No recombination 

Our aim is to establish all possible equilibrium configurations and their dependence on the 
parameters if recombination is absent. In Figure 4, the equilibrium configurations are dis- 
played as schematic bifurcation diagrams with the total migration rate m as the bifurcation 
parameter. In Theorem |4.6[ we assign to each diagram its pertinent parameter combinations. 

In order to have only one bifurcation diagram covering cases that can be obtained from 
each other by simple symmetry considerations but are structurally equivalent otherwise, we 
use the sub- and superscripts X and Y in the labels of Figure 4. For an efficient presentation 
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a 




H 1 »» 



F ( , 



H h 



m m u m 



Fn 



•"Px 



m m m m 



H — h 



m m m m 



"' Px 



m m m 



M 3 



b 




m ° \ = m = m* 



Px 



m nr 



Py 



H — I 1 

m x m* |m Fo | = m Y 



h 



Pa.i 



m = — m = m' 



Pa,: 



Ft, 



Figure 4: Bifurcation diagrams for p = 0. Diagrams (a) - (j) represent all equilibrium and stability 
configurations listed in Theorem |4.6| Each diagram displays the possible equilibria as a function of 
the total migration rate m. Each line indicates one admissible equilibrium, drawn if and only if it 
is admissible. Only equilibria are shown that can be stable or are involved in a bifurcation with 
an equilibrium that can be stable. Lines are drawn such that intersections occur if and only if the 
corresponding equilibria collide. Solid lines represent asymptotically stable equilibria, dashed lines 
unstable equilibria. 
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0<O 



a > b — c > d > e >- / > g 



0=0 



g > / > e > d — ■>■ c — ->■ 6 a 



9>0 



J — *■ 9 



Figure 5: Order in which the bifurcation diagrams of Figure 4 occur as <f> increases from to 1, where 
9 = a x a 2 — /?i/?2- 



of the results, we define 



Px = Pa,1, Py = Pb,2, M| = Mi, m A = \m A \, m Y = \m a \, 



(Rl) 



Px = Pb,2, Py = Pa,i, M, = M 4 , m x = |m B |, m Y = \m A \, 



(R2) 



Px = Pa,i, Py = P B ,2, M, = M 4 , m A = \m A \, m Y = \m a \, 



(R3) 



Px = P B ,2, Py = Pa,i, M, = Mi, m A = \m\ m Y = \m R \, 



(R4) 



Px = Pa.i, M, = Mi, m x = \m f 



(RF) 



Px = Pb2, M| = M 4 , m x = \m B \ 



(R2' 



Px = Pa,i, Py = Pb,2, rn K = |m A |, m Y = |m B |, 



(R3' 



Px = P B ,2, Py = Pa,i, m x = \m% m 



Y - |m A l 



(RF) 



Theorem 4.6. Let p = 0. Figure 4 shows all possible bifurcation diagrams that involve 
bifurcations with equilibria that can be stable for some m given the other parameters. 
A. The following diagrams occur for an open set of parameters: 



1. Diagram (a) in Figure 4 applies if one of the following two cases holds: 

< <f> < <p Ul and dRTb 



(4.45a) 



or 



< < 1 and (R2'|. 



(4.45b) 
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2. Diagram (c) in Figure 4 applies if one of the following two cases holds: 



lMi 



<<p<<j) n and (RV) 



or 



<(p<cp M4 and RRT). 



(4.46a) 
(4.46b) 



3. Diagram (e) in Figure 4 applies if one of the following two cases holds: 



b A <(/)< </> AF ° and pi 



or 



i> BF ° < 4> < <p B and dR3b. 



4- Diagram (g) in Figure 4 applies if one of the following four cases holds: 

cp AF ° <cp< mm{(p Fo , <p AB } and pi]) 



or 



or 



or 



f <(p<cp AB and (jR2l) 



<p AB < cp< 4> Vo and dRll 



max{/°,0 AB } <(/)< cf) BFo and pi 



(4.47a) 
(4.47b) 

(4.48a) 

(4.48b) 
(4.48c) 
(4.48d) 



B. The following diagrams are degenerate, i.e., occur only if the parameters satisfy 
particular relations. 



5. Diagram (b) in Figure 4 applies if one of the following two cases holds: 

A — J.Mi 



11 and (Rl'| 



or 



and (R2'(. 



6. Diagram (d) in Figure 4 applies if one of the following two cases holds: 

4> = 4> A and (|Rrb 



or 



and (R2') 



(4.49a) 
(4.49b) 

(4.50a) 
(4.50b) 
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7. Diagram (f) in Figure 4 applies if one of the following two cases holds: 



6 AF ° and dR2) 



or 



i BF ° and jRl|) 



8. Diagram (h) in Figure 4 applies if 



9. Diagram (i) in Figure 4 applies if one of the following two cases holds: 



fa > ^AB 



and (R3'|. 



or 



< 



iAB 



and (R4 



10. Diagram (j) in Figure 4 applies if one of the following two cases holds: 

cj) = (j) AB < and Mi = Mi 



or 



!> AB > 6 Fo and M, 



M.i 



(4.51a) 
(4.51b) 

(4.52) 

(4.53a) 
(4.53b) 

(4.54a) 
(4.54b) 



C. Figure 5 shows the order in which the bifurcation diagrams of Figure 4 arise if <j) is 
increased from to 1. 

Proof. We prove parts A and B simultaneously and derive the statements about admissibility 
and stability of the equilibria by rewriting the conditions in Section 3.7 in terms of m, m A , 



m B , m F °, and m* (4.3). These critical migration rates satisfy the relations given in (4.9) 



(4.11), (A.19) and (A.37). 



We start by treating the bifurcations and stability of Fq. Using (4.5c) and (4.4c), we infer 



from (3.25): 



Fo 
Fo 



Mi 
M 4 



m | -m Fo and 4> < cf) Fo , 
m t m F ° and <fi > 4> F ° ■ 



(4.55a) 
(4.55b) 



From (4.15) we conclude that (4.55a) applies precisely in the following cases: ( |4.45a ), (4.46a) 



( |447aD , ( |448aD , fl448c| ) (Part A), or fl449a| ), (|450aJ), fl451a| ), ( |454aD (Part B). Similarly, 
( |4.55b[ ) applies in precisely the following cases: ( |4.45b[ ), ( |4.46b[ ), ( |4.47b[ ), ( |4.48b[ ), ( |4.48d[ ) 



(Part A) or ( |4.49b[ ), ( |4.50b[ ), ( |4.51b[ ), ( |4.54b[ ) (Part B). F is admissible for every m > if and 
only if <f> = F °, which corresponds to the remaining three cases (4.52) and (4.53b), (4.53a). 
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Condition (3.26), which determines when Fo changes stability, is equivalent to m = m*. 

and the definitions of m F ° and m* imply that Fq is asymptotically 



Therefore, Proposition 3.4 



stable if and only if either 



< m < |m F °| < to* 



(4.56a) 



or 



holds, where 



< m < to* < I ?n 



Fo | 



< \m °\ < to* 



< to* < Ito 



Fo 



i < 

.Mi 



/Mi 



< < 



or (p > 
M 4 



<M 4 



If (4.56a) applies, according to (4.55), Fq leaves the state space at to = — m F ° or to 



(4.56b) 

(4.57a) 
(4.57b) 

TO F ° 



and exchanges stability with the respective monomorphism. By (4.57a), this occurs in the 



cases (4.45) or (4.49) of the theorem 



If (4.56b) applies, Fo loses stability at to = to* and, generically, either Pa,i or Pb,2 is 
asymptotically stable if to > to* (see below). Fq remains admissible up to to = |to f °|, when it 



collides with Mi or M 4 . By (4.15) and (4.57b), this occurs in the cases (4.46) - (4.48), (4.50) 



(4.51), (4.53), and (4.54) 



Finally, if 



(cases (4.52) and (4.54) in the theorem), M3 becomes stable. This 



follows from the statement below (3.31) together with (4.11a). 



Next, we treat the bifurcations of the SLPs. The SLPs are admissible in intervals of the 
form < to < |to a | or < to < |to b | and leave the state space upon collision with a ME 



(Section 4.2). From (3.32) we conclude by simple calculations that Pa,i is asymptotically 



stable if and only if 



to* < to < |m A | and Ml < cf> < 
as is the case in (|4.46a[), (|4.47a[), ([4.48aP (if min{c/> Fo , 4> AB } = AB ) 



1 AB 



(4.58) 



, and (4.48b), as well as in 



(4.50a), (4.51a), and (4.53b). 



From (3.33), we conclude that Pb,2 is asymptotically stable if and only if 

-M4 



to* < to < |m B | and 6 AB < 6 < 



as is the case in (4.46b), (4.47b), (4.48c), and (4.48d) (if max{f», c/> AB } 



(4.59) 
AB ), as well as in 



(4.50b), (4.51b), and (4.53a). 



It remains to study the stability of the ME. For p = 0, we infer from Section 4.1 and 



Proposition 4.1 



Mi is asymptotically stable 



to > — m F ° and 6 < 6 1 , 



or 



to > —to and 



< 6< 



(4.60a) 
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M3 is asymptotically stable 
M4 is asymptotically stable 



m > max{|m A | , |m B |} and A < <p < 

I m > m B and (fr B < <ft < 4> Ml , or 
I m > m F ° and (b Mi < d>. 



(4.60b) 
(4.60c) 



In conjunction with the above results on Fq and the SLPs, this shows that, except in the 



degenerate cases (4.49), (4.50), (4.52), and (4.54), a ME becomes stable through a transcritical 
bifurcation with either Fo, Pa,i> or Pb,2- In particular, Mi becomes asymptotically stable for 
large m if (4.45a), (4.46a), or (4.49a) applies, M3 becomes asymptotically stable if one of 



( |4.47[ ), Q4.48[ ), ( |4.51| ), ( |4.52[ ), ( |4.53[ ), or ( |4.54[ ) applies, and M 4 becomes asymptotically stable 



if (4.45b), (4.46b), or (4.49b) applies. If 



or 



(4.50), then P A i or P B , 2 , 



respectively, is admissible and asymptotically stable for every m, and every ME is unstable. 
This finishes the proof of parts A and B. 

Part C of Theorem |4.6| follows immediately from parts A and B by applying the relations 
in plBl. □ 



This theorem demonstrates that, for given selection parameters, the equilibrium structure, 
hence also the evolutionary dynamics, depends strongly on the degree <j) of asymmetry of the 
migration rates. However, it is also important to note (and maybe counter intuitive) that 
for symmetric migration (<p = 1/2) any of the ten possible bifurcation diagrams may apply, 
simply by choosing the selection parameters accordingly. 



The bifurcations of equilibria that cannot be stable can be derived easily from Sections 4.2 



4.3 3.7 and the above theorem by noting that these are boundary equilibria and corresponding 
pairs of SLPs are admissible for the same parameters. Inclusion of these bifurcations would 
require the introduction of subcases. In particular, Pa2> Pbi> and M2 are always unstable 



because gamete A1B2 is eventually lost. We observe from (A. 20) and (A.38) that at most one 



pair of SLPs can be admissible if Fo is either unstable or not admissible. If this is the case, 
then one of these SLPs is asymptotically stable (Figure 4). 

Corollary 4.7. If p = 0, the maximum migration rate, below which a stable two-locus poly- 
morphism exists, is given by 



min{|m °|,m*}. 



(4.61) 



The corollary follows from the arguments surrounding ( |4.56 ) and (4.57). 



4.9 Weak recombination 

If m 7^ m* , a regular perturbation analysis of Fo yields the coordinates of a fully polymorphic 
(internal) equilibrium to leading order in p. This equilibrium, F, is asymptotically stable 
(Karlin and McGregor 1972). We denote the first-order approximation of F by F p . Therefore, 
we have F = F p + o(p) and F p = Fo + O(p) as p — > 0. Because the coordinates of F p are much 
too complicated to be informative, we refrain from presenting them. 
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For sufficiently small p, the following properties of F p (hence, of F) can be inferred from 



Proposition |4.1[ Remark 4.2 and Theorem 4.6, Part A.l: 



Mi 
M 4 



m t rn Ml and 
m f m Ui and 



f> < 
<M 4 



(.Mi 



< 



(4.62a) 
(4.62b) 



The above perturbation analysis can not be used to investigate the properties of the internal 
equilibrium F for given small positive p when m is varied in the proximity of m* . Therefore, 
we performed numerical calculations to study the fate of F when p is small and fixed, and m 
increases. It suggests the following: 



F -> P A ,i 
F -> M 3 

F P B ,2 



m t m% and 4> Ml < (p < 

,A — — m B and 



AB 



i AB 



AB 



< < 



1M4 



(4.63a) 
(4.63b) 
(4.63c) 



where and m B are close to m* . Thus, if p is small, F stays close to Fo as m increases from 
until a value close to m* is reached. Then, within a very short interval of m, F moves 'quickly' 
along the manifold given by (A. 8) and (A. 11) to one of the boundary equilibria (Pa,i> Pb,2j 



or M3) on the 'opposite' side of the state space, where it exchanges stability upon collision 
with the respective equilibrium (at m\, m B , or m*). F appears to be asymptotically stable 
whenever it is admissible. 



If one of the cases in (4.62) applies, then Fq can be maintained for higher migration 



rates than F because m Ml and m M4 are decreasing functions in p. Numerical investigations 
support the conjecture that Fo can be maintained for higher migration rates than F whenever 
recombination is weak but positive. Thus, when recombination is weak, decreasing p increases 
the maximum migration rate below which a stable, fully polymorphic equilibrium can be 
maintained. 

4.10 Highly asymmetric migration 



As already discussed in Section 3.8, by introducing weak back migration (i.e., <p close to or 
1) to the CI model, every equilibrium in the CI model gives rise to a unique equilibrium in a 
small neighborhood. This (perturbed) equilibrium has the same stability as the unperturbed. 
For weak or strong recombination, we can strengthen this conclusion. Because the CI model 
with p = is a generalized gradient system (Burger and Akerman 2011, Section 3.4.4) and 



the LE dynamics (3.17) has a globally asymptotically stable equilibrium (Theorem 4.4), the 



proof of Theorem 2.3 of Nagylaki et al. (1999) applies and shows that in both cases the global 
dynamics remains qualitatively unchanged under small perturbations. In particular, no new 
equilibria or limit sets are generated by a small perturbation. 
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Therefore, if p is sufficiently small and <p is sufficiently close to or f, we infer from 



Section 3.8 and Theorem 2 in Burger and Akerman (2011) that the following bifurcation 
pattern applies (where i = 1 or 4): 

• If < m < m Mi , a unique internal equilibrium, F, exists. It is globally asymptotically 
stable. 

• At m = m Mi , F leaves the state space through the ME Mi by an exchange-of-stability 
bifurcation. 

• If m > m Mi , M{ is globally asymptotically stable. 

This pattern is displayed in diagram (a) of Figure 4, where Fq needs to be substituted by F. 



We conjecture that it applies whenever p is sufficiently small and either cp < Ml or <f> > 



(,M 4 



holds. The bounds d) Ml and d> Mi follow from Remark 



M 4 



4.2 



because 



is not needed if p is 



sufficiently small; see (A.32b). However, the upper bounds for p given in Remark 4.2 



are, 



in general, too large to guarantee the above bifurcation pattern. This is known from the 
CI model in which the monomorphic equilibrium (Mi) may be simultaneously stable with 
the internal equilibrium F because an unstable internal equilibrium enters the state space at 
through Mi. If <j> = 1, this may occur if g(«i + Pi) < p < 3ai — cf. (4.65b). For 



m 



m 



M, 



(f) or <j) 7^ 1, we have not been able to determine the upper bound for p below which F 
indeed leaves the state space through M». 

Now we treat large p. Proposition 4.1 and Remark 4.2 show that if p > max{— 02, — (3%}, 
then Mi is asymptotically stable if and only if cj> < A and m > max{— m A , —m B }, and if 
p > ai, then M4 is asymptotically stable if and only if <f> > <p B and m > max{m A , m B }. 

If, in addition to p being sufficiently large, 4> is small or large, then Theorem [44] implies that 
the internal equilibrium (F) leaves the state space through Pa,i, Pb,1) or Pb,2- The respective 



conditions are small perturbations of those given in (4.40a), (4.40b), of (4.40c), respectively. 



Combining theses conditions with those for the stability of the ME and observing (4.12) and 



(4.13), we conclude that the following bifurcation pattern applies if one of the conditions (a) 
«2 < P2 and 4> < 4> A , or (b) P2 < «2 and <p < <^ AB ) or (c) <p > (j) B holds approximately: 

• If < m < m' , a unique internal equilibrium, F, exists. It is asymptotically stable. 

• At m = m', F leaves the state space through a SLP by an exchange-of-stability bifur- 
cation. 

• If m* < m < m", this SLP is asymptotically stable. 

• If m > m", then a ME is asymptotically stable. 

If (a) holds, then m* ~ — m B and the SLP and the ME are Pa,i and Mi, respectively; if 
(b) holds, then m* ~ — m A and the SLP and the ME are Pb,i and Mi, respectively; if (c) 
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holds, then m* ~ m A and the SLP and the ME are Pb,2 an d M4, respectively. Finally, 



m 



max{— m A , —m B } in (a) and (b), and m" = max{m A ,m B } in (c). 



4.11 Maintenance of polymorphism 

As already noted in Section [3. 11 for general parameters the equilibrium configurations could 
not be determined analytically. To explore the potential of spatially heterogeneous selection in 
maintaining genetic variation in the presence of gene flow, we investigate the maximum total 
migration rate, m max , that admits a stable, fully polymorphic equilibrium. We have already 
shown that m max = m™ M holds in the LE approximation (Corollary 4.5), and m m£ " 
holds if p = (Corollary 4.7). From (A. 20) and (A. 38) we conclude that 



1 00 

"max 



1° 

"max' 



(4.64) 



where, as is not difficult to show, equality holds if and only if <j) = AB . 

For the CI model with <j) = 1, Proposition 1 in Burger and Akerman (2011) yields 



' ai + /?! - p 
(ai + ft + pf 



a x 1 + 



Pi - ai 
P 



if < p < min{ai, \{a\ + (4.65a) 
if l(ati+Pi) <p<3«i-/3i, (4.65b) 

if max{ai,3oi — /3i} < p. (4.65c) 



In this case, the fully polymorphic equilibrium is globally asymptotically stable if (4.65a 



or 



(4.65c) apply, but only locally stable if (4.65b) and m is close to m max . A formula analogous 
to (4.65), but with —02 and —02 instead of a\ and 0i, holds if <p = 0. 



In general, we have no explicit formula for m max - However, extensive numerical work, as 



well as (4.65) and the considerations in Section 4.9 suggest that 



(4.66) 



holds always. This is illustrated by Figure 6, which displays the dependence of m max on the 
migration ratio (j) (Figures 6a and 6c) and on the recombination rate p (Figures 6b and 6d) 
for two selection regimes. In Figures 6a and 6b, locus B is under stronger selection in both 
demes. In Figures 6c and 6d, each locus is under stronger selection in one deme. 

In Figures 6a and 6c, and m max are shown as functions of 4>. The inequality (4.64) is 

a conspicuous feature in both cases. Also the shapes of and m max are conspicuous. The 

following properties are easy to prove: is not differentiable at (p = 4> AB and (f) = cf) AB , 

and m®^ is not differentiable at 6 = 6 Ml and 6 



Ma 



m^ ax and m max are piecewise 



convex functions in 



If 



< 



1M1 



1° 

'mux 



i; if 



Ma 



< 



"JVIi 



< < 



1M4 ^0 
' ) '"max 



assumes its minimum at \ provided (f> Ml < \ < cf> M4 . Therefore, m 





max 
M 4 



if 





max 
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Figure 6: The maximum amount of gene flow, m max , admitting an asymptotically stable two-locus 
polymorphism as a function of </> or p. In panels a and b, locus B is under stronger selection than locus 
A in both demes (012 = — 2ai = —1, /?i = — (5% = 2, 8 = 1). In c and d, different loci are under stronger 
selection in the two demes (ai ~ —fa — 0.4, fa — —a-i = 2, 9 = 3.84). Panels a and c show m max 
as a function of 4> for complete linkage (m!^^, (4.61)) and under linkage equilibrium (m^ ax , (4.43l). 
Panels b and d display m max for the indicated values of as a function of p. Here, m max is obtained 
by determining numerically the critical migration rate when the stable internal equilibrium hits the 
boundary. This is done by computing when the leading eigenvalue at the boundary equilibrium is zero 
and by calculating the coordinates of the fully polymorphic equilibrium in a small neighborhood. In a 
and b, we have </> AB = | (indicated by the kink in the dashed line in a), 
(h Mi = |. In c and d, we have 



lB 



26 ' 



— 17' V 
iM 4 _ 25 



lAB 



attains its maximum at < 
assumes its maximum at 
Notably, mi 



Mi 



or 



1M4 



m^ ax increases if 



< 



b AB and decreases if . 



> 



aAB 



It 



iAB 



,00 
''max 





max 



Numerical work suggests that indeed m E 



m^ ax = holds independently of p if 4> = cp AB . If 8 = 0, then (fi A = cp B = (p AB = cp Fa 



The latter condition is equivalent to (3.36c). Therefore, the 



and m^ ax = m^ ax if 4> = (j) AB . 
analysis in Section 3.10 applies and shows that an internal equilibrium, which presumably is 
globally asymptotically stable, exists always. 

Figures 6b and 6d illustrate the effect of recombination on m max for different values of 
<f). In all cases investigated, m max decreased monotonically with increasing p. These findings 
support the conjecture that (4.66) is always valid. Therefore, m^, ax — m^ ax serves as a useful 
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estimate for the sensitivity of m max to variation in p. We can prove that m max — m^ ax is 
maximized at cj) = </> Ml , or at = cj) M4 , or at = if /?2 < ct2- 



Although we proved that m max < ni^ ax can occur (Section 4.7), all numerical examples 
showed that m max is only very slightly smaller than m^ ax in this case (results not shown). 
Therefore, our results suggest that the cases of LE (infinitely strong recombination) and of 
no recombination 'essentially' bracket the range of parameters for which both loci can be 
maintained polymorphic. 

As Figures 6a and 6c show, the range of values (f) for which the equilibrium structure can 



be expected to be similar to the CI model, i.e., <p < min{0 Ml , AB } or 4> > <ft Mi (Section 4.10) 
can vary considerably. 



Finally, we infer from Proposition 4.1 that none of the ME is stable if m < max{|m A |, |m B |}. 
Hence, in this case at least one locus is maintained polymorphic. By contrast, we have shown 
that no SLP is admissible if m > max{|m A |, |m B |}. However, as demon- 



in Section 



4.2 



strated by our results for p = 0, an internal equilibrium may be asymptotically stable if 
max{|m A |, |m B |} < m < ?7i max . These results suggest that no genetic variability can be 
maintained if 

m > max{|m A |, |m B |, ra max }. (4-67) 

This bound is best possible if p = 0. For sufficiently large p, the corresponding bound is 
max{|m A |, |m B |}. 

5 Migration load and local adaptation 

Here, we briefly investigate some properties of the migration load of the subpopulations and 
of the total population. We use these migration loads as simple measures for local adaptation 
(but see Blanquart et al. 2012). Mean fitness in deme k is given by Wk = ak(2pk — 1) + 
f3f.(2qf. — 1), with its maximum at + Therefore, the migration loads in demes 1 and 2, 
defined as the deviation of Wk from its maximum, are given by 

Li = 2(ai(l-pi)+ J 8i(l-gi)) and L 2 = 2(-a 2 p 2 - M- (5.1) 

Assuming that the subpopulations are of equal size, we define the load of the total population 
by L= |(Li + L 2 ). 

If migration is weak, we can calculate the migration load in each deme at the fully poly- 



morphic equilibrium F (Proposition 3.2) to leading order in m\ and m^- For deme 1, we 
obtain 

Lx-lmx — — — , (5.2) 

Oil + PI + P 

and an analogous formula holds for deme 2. Obviously, the migration load increases with 
increasing migration rates m-i or rri2, hence with m, in each of the demes and in the total 
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population. Simple calculations show that each of the loads also increases with increasing 
recombination rate p if migration is weak. 

In general, however, the load in each deme does not always increase with increasing m. 
The reason is that for sufficiently strong migration, generically, first one locus, then one of the 
haplotypes becomes fixed (Proposition 4.3). If this is either A\B\ or A2B2, then the load in 
the corresponding deme will vanish for high migration rates, whereas that in the other deme 
will be very high. In such a case, the load of the total population may also decrease with 
increasing m. This occurs for large migration rates (not far below m max ) and it can occur 
for completely linked loci as well as for loci in LE. In the CI model, the load always increases 
with the migration rate (Burger and Akerman 2011) 

Finally, although L is increasing in p if migration is weak, this is not necessarily so if 
migration is strong. By using a grid of parameter combinations, we showed numerically that 
in about 0.34% of more than 10 6 combinations of a\, a%, /Si, ,82, m, an d (f>, the total load L at 
the equilibrium is lower than that at Fo (results not shown). Again, this occurs for high 
migration rates, not far below the value m^ ax at which Fqo leaves the state space. Then a 
population maintained fully polymorphic by tight linkage may have a higher total load than 
a population in which fixation of a locus or a haplotype is facilitated by high recombination. 
In all such cases, selection in one deme was (considerably) stronger than in the other, and 
in more than 70% of the specialist haplotype became fixed at very high migration 

rates. In summary, under a wide range of conditions in this model, reduced recombination 
is favored, but there are instances where increased recombination is favored (cf. Pylkov et al. 
1998; Lenormand and Otto 2000). 



6 Fst and differentiation 

The most commonly used measure for quantifying differentiation in spatially structured pop- 
ulations is Fst- For diallelic loci, Fst can be defined as F^t = p(i^p) > where Var(p) is the 
variance of the allele frequencies in the total population and p is the allele frequency averaged 
over the demes. Estimators of multilocus -Fst are usually defined as weighted averages of one- 
locus -Fgx estimators (e.g., Weir and Cockerham 1984, Leviyang and Hamilton, 2011). Here, 
we extend Nagylaki's (1998) approach and define a genuine multilocus version of F^t that 
measures the covariance of the frequencies of (multilocus) haplotypes. We restrict attention 
to the diallelic two-locus case, but the extension to multiple multiallelic loci is evident. A 
general multilocus theory of fixation indices will be developed elsewhere. 

Let Cfc denote the proportion of the population in deme k, so that = 1. Then the 

frequency of haplotype i in the entire population is x~i = Ylk c k x i,k- Because our subpopula- 
tions are randomly mating, the frequency of genotype ij in the entire population is given by 
XiXj = Ylk c k x i,kXj,k- Following eqs. (6a) and (6b) in Nagylaki (1998), we define FsT,ij as a 
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standardized measure of the covariance of the frequencies of haplotypes i and j: 



x i = x i + F ST,uXi(l - Xi), (6.1a) 
xjx] = (1 - F S T,ij)xiXj. (6.1b) 

The multilocus, or haplotype, heterozygosity in the entire population can be defined as 

h s = ^2 XjX] = ^2(xi - xf), (6.2) 

where runs over all haplotypes. If the entire population were panmictic, its multilocus 
heterozygosity would be 

kr = y^Xjjl - Xi). (6.3) 

i 

Thus, 1 — hx is the probability that two gametes chosen at random from the entire population 
are the same haplotype. 

Following eq. (32) in Nagylaki (1998), we define Fst by 

FsT = h~ Yl " ^) F st,u. (6.4) 

i 

Then Fst can be written as 

FsT = l-^ = v E ^ r(X _ ) v (6.5) 

h T 2^iXi{l-Xi) 

in direct generalization of the classical formula given above. 

We focus on the dependence of the equilibrium value of Fst on the migration parameters 
m and </> and on the recombination rate p. Because we obtained the coordinates of the stable, 
fully polymorphic equilibrium equilibrium F explicitly only in special or limiting cases, explicit 
formulas for Fst can be derived only in these cases. For instance, if migration is weak, we 



obtain from (3.16) that, to leading order in m, 

+ («i + f3i)p 1 - <f> a 2 /?2 - ("2 + $-i)p 



Fst = 1 — m 



c 2 ai/?i(ai + Pi + p) ci a 2 /?2(a 2 + fa ~ P) 



(6.6) 



Here, Fst increases with decreasing p, and decreases with increasing m. Thus, stronger linkage 
leads to increased differentiation if migration is weak. 

Figure 7 illustrates for two selection scenarios how Fst, evaluated at the stable, fully 
polymorphic equilibrium F, depends on the total migration rate m and the recombination 
rate p. In diagrams (a) and (c) of Figure 7, it is assumed that locus B is under stronger 
selection than locus A in both demes. It shows that Fst usually declines with increasing 
migration rate. However, there are a few instances, where Fst increases if m is slightly below 
the migration rate at which the fully polymorphic equilibrium loses admissibility. In diagrams 
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Figure 7: Fgx as a function of the total migration rate m. In panels a and c, locus B is under stronger 
selection in both denies {a\ = \, a% = — 1, /3i = — f3 2 = 2, 6 = 1). In panels b and d, locus A is 
under stronger selection than B in deme 2, and locus B is under stronger selection than A in deme 1 
(«i = — /?2 = 0.4, fix = —OL2 = 2, 8 = 3.84). Note that in all cases, Fst is also monotone decreasing in 
p. For p = and p = oo (LE), the lines are from numerical evaluation of (6.5) by substitution of the 
coordinates of Fo ( 3.24| or (3.18). For other values of p, the numerically determined coordinates 
of the internal equilibrium are used. 



(a) and (c) of Figure 7, differentiation between the populations experiences the fastest decline 
for weak migration (relative to the selection parameters), whereas this is not necessarily so in 
diagrams (b) and (d). There, Fst may experience its strongest decrease if migration is strong. 

Figure 7 also shows that at large migration rates, Fst may increase if the recombination 
rate increases, i.e., Fst is n °t minimized under linkage equilibrium. However, this occurs 
only for large recombination rates, i.e., larger than the largest selection coefficient. This 
is compatible with the finding in Section 4.11 that at high recombination rates, m max may 
(slightly) increase in p, and the finding in Section [5] that the load L may decrease with 
increasing ui. We note that this 'aberrant' behavior of ?n max , L, and F^t does not necessarily 
occur for the same parameter combinations. Among more than 10 6 parameter combinations 
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of ax, Q!2)/?ij 02, Tn, and <j), we found no instance where Fst evaluated at the equilibrium Foo 
was higher than that at Fo (results not shown). Importantly, if recombination is weak or 
migration is weak then Fst apparently always increases with tighter linkage. 

Comparison of our multilocus Fst with averages of single-locus Fst values showed that the 
multilocus Fst declines somwehat faster at small migration rates than the averaged single- 
locus .Fst- For large parameter regions, the qualitative behavior of these measures of dif- 
ferentiation is the same. Differences occur only for a subset of selection coefficients at high 
migration rates and high recombination rates. Finally, we mention that our multilocus Fst 
is a sensitive measure of differentiation only if the effective number of haplotypes is low. This 
parallels the well known fact that the classical -Fst is a sensitive measure of differentiation 
only if the effective number of alleles is low (e.g., Nagylaki 1998, 2011). Thus, our multilocus 
Fst may be most useful if applied to short sequences of DNA. A thorough and more general 
study is in preparation. 



7 Invasion of a locally beneficial mutant 



Differentiation between subpopulations can be increased by the invasion of mutants that 
establish a stable polymorphism at their locus. Therefore, we consider a locus (A) at which 
a new mutant A\ arises that is advantageous relative to the wild type Ai in deme 1, but 
disadvantageous in deme 2. In terms of our model, we assume ax > > a%- If locus A is 
isolated, this mutant can invade and become established in a stable polymorphism if and only 
if | ax + 02 1 < 1 ; cf . (3.7) and (3.9). Using m and <f>, this condition can be rewritten as 



m < \m 



(7.1) 



see (4.3a) and (4.4a), or 



m + a 2 , A 



< < 



m — a 2 



m 



We restrict attention to the case 



m 



(7.2) 



> 



A (4.2a) when the influx of the deleterious allele A 2 
into deme 1 is sufficiently strong such that A2 is protected. (The case cj) < is symmetric 
and more suitable to study invasion of A2 under influx into deme 2 of Ai which is deleterious 
there.) Then the mutant Ax can invade if any of the following equivalent conditions hold: 



m < m 



(7.3a) 



ax > 



a2m0 
«2 — mil 



mx 



1 - m 2 /a 2 ' 



or 



< < 



(7.3b) 



(7.3c) 
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where 0; nv > 1 if and only if m < oi\. Thus, A\ can always invade if m < Q\. For the CI 
model (4> = 1), each of the conditions in (7.3) simplifies to the well known invasion condition 
m < a\ (Haldane 1930). The conditions (7.3) show that invasion is facilitated whenever back 
migration is increased, either by keeping mi constant and increasing ?ti,2, or by fixing m and 
decreasing <f>. 

For the CI model it was proved that invasion of a locally beneficial mutant is always 
facilitated by increased linkage to a locus in migration-selection balance (Burger and Akerman 
2011). In fact, mutants of arbitrarily small effect can invade provided they are sufficiently 
tightly linked to this polymorphic locus which may be considered as the background in which 
the new mutant appears. 

Here, we investigate whether this is also the case with two-way migration. Thus, we assume 
that locus B is in migration-selection balance (which requires that analogs of (7.3) are satisfied 
for Pi and f5<i) and a locally beneficial mutant Ai arises at the linked locus A. Hence, the 
model in Section 2 applies and we assume (2.3). 

Because we are mainly interested in the invasion properties of mutants of small effect, we 
assume that locus B is under stronger selection than A, i.e., \at\ < |/3fc| in deme k = 1,2. 
Before the mutant Ai arises, the population is at the equilibrium Pb,2 (where |ri + t%\ < 1 
must hold for admissibility; see Section 3). Ai can invade if Pb,2 is unstable. Since the 
eigenvalues determining external stability are zeros of a complicated quartic equations, the 
stability of Pb,2 cannot be determined analytically. We expect that the new stable equilibrium 
that will be reached is the fully polymorphic equilibrium F. For the CI model, this was be 



proved in (Burger and Akerman 2011). For the case of LE, it follows from Theorem 4.4 



Figure 8 displays typical results about the invasion of the mutant A\. In Figure 8a, the 
maximum recombination rate admitting invasion, denoted by p maX5 is shown as a function of 
cf). In the shaded region, Ai can invade. If <p < 0i nv = 0.55, (7.3c) implies that Ai can always 
invade. If <j) > (fiinv, there exists p max < oo, such that A\ can invade only if p < p max , i.e., if 
Ai is sufficiently tightly linked to locus B. In Figure 8b, the minimum selection coefficient ct\ 
necessary for invasion of A\ is shown as a function of p/m for various values of (p. These values 
are obtained by computing when the leading eigenvalue that determines external stability of 
Pb,2 equals zero. 

We conclude that, as in the CI model, mutants of arbitrarily small effect can invade 
provided they are sufficiently tightly linked to a locus that is already maintained in migration- 
selection balance. In addition, as shown by both panels in Figure 8, increasingly symmetric 
migration facilitates the invasion and establishment of locally beneficial alleles. 
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Figure 8: Invasion properties of locally beneficial alleles. In a, the maximum recombination rate 
between loci A and B, below which invasion of Ai can occur, is displayed as a function of <j). The 
parameters a\ = —a 2 = 0.1, /?i = — 2/3 2 = 2, and m — 1 are fixed. Therefore, 4> h = \ and 0; nv = 0.55. 
In b, the minimum selective advantage a\ required for invasion of Ai is shown as a function of p for 
different values of <f>. The parameters a 2 = —0.1, j3\ = —2(3 2 = 2, and m = 1 are fixed. 

8 The effective migration rate at a linked neutral site 

Linkage to loci under selection may impede or enhance gene flow at a neutral marker locus. 
In the first case, linkage may act as a barrier to gene flow. This was shown by the work of 
Petry (1983), Bengtsson (1985), Barton and Bengtsson (1986), and Charlesworth et al. (1997), 
who developed and studied the concept of the effective migration rate as a measure of the 
'effective' gene flow at a neutral site. More recently, the effective migration rate was studied 
for CI models with selection on a single locus in a class-structured population (Kobayashi 
et al. 2008) or with selection on two linked loci (Burger and Akerman 2011). Fusco and 
Uyenoyama (2011) investigated the consequences of a selectively maintained polymorphism 
on the rate of introgression at a linked neutral site under symmetric migration between two 
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Figure 9: The effective migration rate m e ff as a function of m for a\ = —a 2 = 0.1, /3i = —/3 2 = 0.2, 
4> = \, and p = 0.2. Recall that p = pan + Pnb- Lines show the weak-migration approximation of m e ff 



(8.3). Symbols give the exact numerical value of m e ff = —A 



AT- 



denies. 

Here, we derive an explicit expression for the effective migration rate at a neutral locus 
(N) that is located between the two selected loci, A and B. Recombination between locus A 
(B) and the neutral locus occurs with rate pan (pnb) such that p = pan + Pnb- Thus, only 
one crossover event occurs in a sufficiently small time interval. We assume that pan and pnb 
are positive, i.e., the neutral locus is not completely linked to a selected site. We consider two 
variants at the neutral locus, N\ and N 2 , each with arbitrary, positive initial frequency in at 
least one deme. The frequency of N± in deme k(= 1,2) is denoted by n^. We model evolution 
at the three loci by a system of 7 x 2 ordinary differential equations for the allele frequencies 
and linkage disequilibria { Pl , p 2 , qi, q 2 , Df B , D$ B , n u n 2 , Df N , L>£ N , D^ B , D^ B , £>f NB , 
rj>2 NB )- We refrain from presenting the equations for the allele frequencies at the neutral 
locus and the associated linkage disequilibria because they are a straightforward extension of 
those in Section 4.6 of Burger and Akerman (2011). 

Obviously, the equilibrium allele frequencies at the neutral locus are the same in each deme 
and given by the initial allele frequencies averaged over the two demes: 



m2«i min2(0) 

n i = n 2 = n = 1 ■ 

m to 



i.l) 



The equilibrium frequencies at the two selected loci are independent of the neutral locus and, 
thus, the same as in the two-locus model treated above. The linkage disequilibria involving 
the neutral locus (D^ N , D^ B , and -D^ NB ) are zero at equilibrium. By (8.1), there is a one- 



dimensional manifold of equilibria resulting from the absence of selection at the neutral locus. 

We assume that parameters are such that the fully polymorphic equilibrium F is admissible 
and globally asymptotically stable. Using the above order for the allele frequencies and linkage 
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equilibria, the Jacobian at the equilibrium F has block structure, 

'=("? *)• < 8 - 2 ' 

where J5 is the Jacobian describing convergence of (pi,p2, qi-, q 2 , D^ B , D^) to F, and Jn is 
the Jacobian describing convergence of (m, n 2 , D^ N ,D$ N ,D^ B , D^ B , L>f NB , D$ NB ) to 
(h,n, 0,0, 0,0, 0,0). 

Because zero is the leading eigenvalue of Jn , the rate of convergence to equilibrium at the 
neutral locus is determined by the second largest eigenvalue of Jn, which we denote by A at. 
We define the effective (total) migration rate by m e ff = — A at (Bengtsson 1986, Kobayashi et 
al. 2008, Burger and Akerman 2011). It can be checked that under weak migration, i.e., to 
leading order in mi and m 2 , one obtains 

\ PanPnb . PanPnb /„ „n 

maf = -X N = m 1 ■ — — + m 2 v --r (8.3) 

(PAN + «l)(PNB + Pi) (PAN - «2)(PNB ~ Pi) 

(a Mathematica notebook is available on request). If the neutral site is linked only to one 
selected locus (e.g., because j3\ = f3 2 = 0), then 

PAN . PAN (Q A s 

TO e fF = mi h m 2 (8.4) 

PAN + Oil PAN - «2 

is obtained. Thus, two linked selected loci act as a much stronger barrier to gene flow than 
a single selected locus, especially if the recombination rate between the two loci is not much 



larger than the selective coefficients. In Figure 9, the approximation (8.3) of the effective 
migration rate m e ff is displayed as a function of m for various parameter combinations and 
compared with the exact value obtained by numerical evaluation of Aj\r. 

We note that m e ff is (approximately) the sum of the two effective one-way migration 
rates (Burger and Akerman 2011) and closely related to Kobayashi and Telschow's (2011) 
effective recombination rate. Our result complements their explicit example on two-locus 
incompatibilities. We refer to their paper for the discussion of the relation of this concept of 
an effective migration rate to that of Bengtsson (1985) and for applications in the context of 
speciation theory. 



9 Discussion 



The purpose of this investigation was to improve our understanding of how genetic archi- 
tecture, in particular recombination and locus effects, as well as the pattern and amount of 
migration determine polymorphism, local adaptation, and differentiation in a subdivided pop- 
ulation inhabiting a heterogeneous environment. For simplicity, we restricted attention to two 
linked, diallelic loci and to migration between two demes. The study of diversifying selection 
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in just two denies may also shape our intuition about clinal variation if the two subpopu- 
lations are from different ends of the cline. If alleles are beneficial in only one environment 
and detrimental in the other, local adaptation of subpopulations and differentiation between 
them can be obtained only if a (multilocus) polymorphism is maintained. Therefore, most 
of our mathematical results focus on existence and stability of polymorphic equilibria and on 
the dependence of the equilibrium configurations on the model parameters (migration rates, 
selection coefficients, recombination rate). 

The model is introduced in Section 2. Sections 3 and 4 are devoted to the derivation 
of the possible equilibrium configurations and bifurcation patterns. They contain our main 
mathematical results. Explicit analytical results about existence and stability of equilibria 
were obtained for several limiting or special cases and are complemented by numerical work. 

The conditions for admissibility of all single-locus polymorphisms (SLPs) are given in 
Section 3.1 those for asymptotic stability of the monomorphic equilibria (ME) in Proposition 



3.1 in Section 3.2 The stability of SLPs could not generally be determined (Section 3.3). 



Weak migration is treated by perturbation methods in Section 3.4 For sufficiently weak 
migration, there exists a globally attracting fully polymorphic equilibrium, F (Proposition 



3.2). Its approximate coordinates are given by (3.16). 



The complete equilibrium and stability structure could be derived under the assumption 
of linkage equilibrium (Section 3.5). The unique, fully polymorphic equilibrium F = Foo is 
admissible and globally attracting if and only if all four SLPs are admissible. Otherwise, 
one boundary equilibrium (SLP or ME) is globally asymptotically stable (Proposition 3.3). 
These results extend straightforwardly to an arbitrary number of diallelic loci. Based on 
these results, nonlinear perturbation theory establishes the existence of a globally stable, 
fully polymorphic equilibrium in a perturbed parameter range if recombination is sufficiently 
strong (Section 3.6). This equilibrium is in quasi-linkage equilibrium and given by (3.21). 

Also for completely linked loci all equilibria and their local stability properties could be 
derived (Section 3.7). In this case, the fully polymorphic equilibrium Fo (3.24) may lose 
stability while it is admissible (3.28). At this threshold a boundary equilibrium becomes stable 
by a 'jump bifurcation' (Proposition 3.4). In general, however, more complicated equilibrium 
patterns than determined by Propositions 3J3 and 3^ can occur, in particular, multiple stable 
equilibria. 



In Section 3.8 we apply perturbation theory to infer the equilibrium properties under 
highly asymmetric migration from those derived for the continent-island model in Burger and 
Akerman (2011) and Bank et al. (2012). There, a stable (F) and an unstable fully polymorphic 
equilibrium may exist if recombination is intermediate, and F is simultaneously stable with 
a boundary equilibrium. In general (Section 3.11), we cannot exclude the existence of more 
than two internal equilibria or complicated dynamical behavior. Numerical searches produced 
no such instances. What can be shown easily is that, if p < oo, any fully polymorphic equi- 
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librium exhibits LD. In all cases, where an internal equilibrium was calculated (numerically 
or analytically), it exhibited positive LD. 

In the super-symmetric case, in which selection in deme 2 mirrors that in deme 1 and 
migration is symmetric, an assumption made in several applications, a fully polymorphic 
equilibrium exists always and, presumably, is stable (Section 3.10). This is a highly degenerate 
situation because if 9 ^ 0, only a monomorphic equilibrium can be stable for sufficiently large 
migration rates (Proposition 4.3). If 9 = (Section 3.9), then a fully polymorphic equilibrium 
can exist for arbitrarily large migration rates if cf> = 4> AB (see also Section 4.11). 

Whereas in Section 3 the focus was on the efficient presentation of the existence and sta- 
bility results of equilibria, in Section 4 these results are used to derive the possible bifurcation 
patterns with the total migration rate m as the bifurcation parameter. All possible bifurca- 
tion patterns could be derived under the assumption of LE (Theorem 4.4 Figures 2 and 3), 
and under the assumption of complete linkage (Theorem 4.6, Figures 4 and 5). The latter 
case is considerably more complex. Interestingly, in each case, every bifurcation pattern can 
occur for every ratio <p = m\/m of migration rates by choosing the selection coefficients ap- 
propriately. Hence, the assumption of symmetric migration does not yield simpler equilibrium 
configurations than general migration if arbitrary selection coefficients are admitted. 

In each of these cases (LE or p = 0), we determined the maximum migration rate TTimax 



admitting an asymptotically stable, fully polymorphic equilibrium (Corollaries |4.5| and 4.7). 
The maximum migration rate m^ ax for p = always exceeds or equals that (m™ ffi ) for LE, 
i.e., m-max — m max- Although for strong recombination, m max can be very slightly smaller 
than m^ ax (Section 4.7), in the vast majority of investigated bracketed by 

m max an d n-max (Figure 6, Section 4.11). 



Proposition |4.3| demonstrates that a ME is globally attracting if migration is sufficiently 
strong (except in the degenerate case noted above). If we interpret the equilibria M2 and M3 
as fixation of a generalist (A1B2 and A^B\ are haplotypes of intermediate fitness), and Mi 
and M4 as fixation of a specialist (A\B\ and A2B2 are the locally adapted haplotypes), then 
depending on the sign of 9 one of the generalists becomes fixed for high m if is intermediate 
(i.e., (p k < (p < 4> B if 9 > 0, <fi B < <p < <p A if 9 < 0; but note that, depending on the selection 
coefficients, both cj) A and <^> B can be arbitrarily close to or 1.). The critical value m as well 
as (j) A and cp B are independent of p. Otherwise, one of the specialists becomes fixed for large 
m. 

The fact that a generalist becomes fixed for strong migration is a distinct feature of (bal- 
anced) two-way migration: in the CI model or if migration is sufficiently asymmetric (4> < <p A 
or <p > <P B if > 0), one of the specialist haplotypes swamps the populations and becomes 
fixed. Another difference between highly asymmetric and more symmetric migration patterns 
is that in the first case, it is always the locus under weaker selection that first loses its poly- 



morphism while m increases, whereas this not necessarily so in the latter case (see Section 4.2 
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and Theorem 4.6 cases A3 and A4). 

In summary, we determined quantitatively when the following three evolutionarily sta- 
ble states discussed by Kawecki and Ebert (2004) occur: (i) existence of a single specialist 
optimally adapted to one deme and poorly to the other, (ii) existence of a single generalist 
type which has higher average fitness in the whole population than than any of the special- 
ists, and (hi) existence of a set of specialists each adapted to its deme, i.e., coexistence in a 
polymorphism. Local adaptation and differentiation occur only in case (hi). 

In Section 5, we used the migration load in each deme to quantify the degree of local adap- 
tation. In Section 6 we introduced a new multilocus version of Fst to measure differentiation. 
If migration is weak, then local adaptation and differentiation decrease with increasing migra- 
tion rate and increase with increasing linkage between the loci (Figure 7). In particular, for 
given (small) migration rate, local adaptation and differentiation are maximized if the htness 
effects are concentrated on a single locus (corresponding to p = in our model). However, as 
discussed in Section 5, for high migration rates, the migration load of the total population can 
decrease with increasing recombination or migration rate. Similarly, at high recombination 
and migration rates, F^t can increase with increasing migration or recombination rate. Thus, 
for given, relatively high migration rate, i*sT may be minimized at intermediate recombination 
rates. Apparently, it is always maximized in the absence of recombination. 

In Section 7, we investigated the conditions for invasion of locally beneficial mutants. At 
an isolated locus, such a mutant can invade and become established in a migration-selection 
equilibrium if and only if its advantage exceeds a threshold that increases with the immigration 
rate of the wild type; see (7.3b). If, however, this mutant occurs at a locus that is linked to a 
locus that is already in migration-selection balance, then its invasion is facilitated, i.e., its local 
selective advantage can be smaller (Figure 8b). Equivalently, for given selection coefficients 
and total migration rate, the minimum recombination rate needed for invasion increases if 4>, 
or the influx of the (deleterious) wild type relative to the efflux of the new mutant, increases 
(Figure 8a). For the extreme case of one-way migration from a 'continental' population to 
an 'island' population that is adapting to a new environment, Burger and Akerman (2011) 
proved that invasion of a locally beneficial mutant is always facilitated by increased linkage 
to a locus in migration-selection balance. 

Thus, our results complement the numerical finding by Yeaman and Whitlock (2011) for 
a multilocus quantitative-genetic model that clusters of locally adaptive mutations, or con- 
centrated genetic architectures, build up in spatially structured populations with opposing 
selection pressures in two demes. Because tighter linkage is required for invasion under in- 
creasingly asymmetric migration rates, more concentrated architectures and a greater ad- 
vantage for recombination-reducing mechanisms (such as chromosome inversions) should be 
expected for highly asymmetric migration. In finite populations, invasion of new mutants 
occurs only with a certain probability, and genetic drift may erase polymorphism. Numerical 
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work, supported by analytical methods, has already shed some light on the dependence of 
the probability of establishment of new, locally adaptive mutations on the recombination rate 
and other factors (Yeaman and Otto 2011, Feder et al. 2012). Analytical work on the role of 
genetic drift and finite population size on these issues is in progress. 

Our results also show that, in the absence of epistasis and under the present form of balanc- 
ing selection, reduced recombination between selected loci is favored, except when migration 
rates are sufficiently symmetric and high (Section 5). Selection inducing certain forms of 
epistasis may favor high recombination in structured populations more easily (Pylkov et al. 
1998; Lenormand and Otto, 2000; Bank et al. 2012). Therefore, general predictions about 
the emergence of clusters of locally adaptive mutations in regions of reduced recombination, 
or of genomic islands of speciation (Wu and Ting 2004) or of differentiation (Feder et al. 
2012), can not be made in the absence of detailed information about epistasis and the spatial 
pattern of selection and migration. At least in the absence of epistasis, the most favorable 
situation for the emergence of such clusters should occur in populations that are adapting to 
a new environment, still receiving maladaptive gene flow but sending out only very few or no 
migrants (corresponding to a continent-island model). 

In Section 8, we derived the approximation (8.3) for the effective migration rate at a 
linked neutral locus that is located between the selected loci. This approximation is simply 
the sum of the two effective migration rates under one-way migration (Burger and Akerman, 
2011). Because in the present model, polymorphism at the selected loci is maintained by 
balancing selection, the effective migration rate may be greatly reduced compared with the 
actual migration rate (see Figure 9). Thus, strong barriers against gene flow may build up at 
such neutral sites and enhance (neutral) differentiation (see Charlesworth and Charlesworth 
2010, Chap. 8.3). Future work will have to study the actual amount and pattern of neutral 
diversity at such sites in finite populations. 



Acknowledgments 

We are grateful for useful comments on the manuscript by two anonymous referees. One of 
them inspired us to introduce the new multilocus fixation index. This work was supported 
by grants P21305 and P25188 of the Austrian Science Fund FWF. Support by the Vienna 
Graduate School of Population Genetics funded by the Austrian Science Fund (FWF, W1225) 
is also acknowledged. 



53 



A Appendix 



A.l Sufficiency of the assumptions (2.3) 



By relabeling alleles, we can assume without loss of generality (2.3a). Generically, one of the 
following nine parameter sets applies: 



(A.la) 
(A.lb) 
(A.lc) 
(A.ld) 
(A.le) 
(A.lf) 



9 > 0, 


Oil < Pi, 


and «2 > P2 


9 > 0, 


Oil < Pi, 


and «2 < P2 


9 > 0, 


ai > Pi, 


and 02 < Pi 


9 < 0, 


ai > Pi, 


and «2 < P2 


9 < 0, 


ai > Pi, 


and «2 > P2 


9 < 0, 


Oil < Pi, 


and 02 > P2 


there are the following three parameter sets: 


9 = 0, 


ai < Pi 


and a 2 > P2, 


9 = 0, 


Oil = Pi 


and ai2 = P2, 


9 = 0, 


ai > Pi 


and 02 < P2- 



(A.lg) 
(A.lh) 
(A.li) 



The sets (A.la) - (A.li) yield the complete parameter space of the selection coefficients. 

We show that the parameter sets (A.lc) - (A.lf) can be derived from (A.la) and ( |A.lb[ ) by 
simple transformations. Let / denote the exchange of loci, i.e., = Pk an d f(Pk) = a k, 

and g the exchange of demes, i.e., g(ak) = —ak* and g(Pk) = ~Pk*- We observe that 
sign(/(#)) = sign(g(9)) = — sign(#) and 



(A.la) A (A.ld) A (A.lc) -4 (A.lf), 



(A.lb) A- (A.le) 



(A.2a) 
(A.2b) 



hold. Therefore, (2.3) is sufficient to describe the (generic) parameter region where 9^0. 
Since 



(A.lg) A (A.li), 



(A.3) 



(3.34) is sufficient to describe the degenerate cases 9 = 0. 



A. 2 Proof of Proposition 3.1 



At each monomorphic equilibrium, the characteristic polynomial factors into three quadratic 
polynomials, P(X) = ti(X)t2(X)ts(X) ■ Two of them, ti(X) and £2 (A), determine stability with 
respect to the adjacent marginal one-locus systems. The corresponding conditions are already 
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known from one-locus theory. The third, £3 (A), determines stability with respect to the interior 
of the state space. 



In the following, we derive the stability conditions (3.10) and (3.11) for Mi. Those for M4 



can be deduced analogously or by symmetry considerations by taking into account that (2.3b) 
implies min{ai,0i} = a±. The stability analysis of M2 and M3 is much simpler and left to 
the reader. 

For Mi, it is straightforward to show that 



ti(A) = A 2 + [oi(l + 0-1) + a 2 (l + cr 2 )]A + aiQ 2 (l + 01 + cr 2 ), 
t 2 (A) = A 2 + [/3i(l + ri) + 2 (1 + r 2 )]A + 0102(1 + n + r 2 ), 
t 3 (A) = A 2 + (ai + a 2 + 0i + 2 + 2p + mi + m 2 )A 

+ (ai + 0i + mi + p)(a 2 + 2 + m 2 + p) - mim 2 . 



(A.4a) 
(A.4b) 

(A.4c) 



Because t"(X) > for every A, ^(0) = a%(l + 01) + a 2 (l + cr 2 ) > if cj 2 < -1, ii(0) > if and 
only if a\ + <7 2 < —1, and mhiA{ii(A)} < 0, we conclude that the two eigenvalues emanating 
from t\ are negative if and only if 



ai + (j 2 < -1. 

Analogously, the two eigenvalues emanating from i 2 are negative if and only if 

Tl + r 2 < -1, 

and those originating from £3 are negative if and only if 



m 2 > 



(a\ + 0i + mi + p)(a 2 + 02 + p) 
ai + 01 + p 



(A.5a) 



(A.5b) 



(A.5c) 



Conditions (A. 5a) and (A. 5b) yield (3.10). 



Concerning (A. 5c), we observe that it is always satisfied if p > — (a 2 + 2 ) because then the 



right-hand side is negative. Next we show, that (A. 5c) is also satisfied if p > — a 2 . Because 



the right-hand side of (A.5c) is strictly monotone decreasing in p, it is sufficient to prove that 



(A. 5c) holds if p = —02- Then simple rearrangement of (A. 5c) leads to the condition 



7712 (ai + 01 - 02) Oil + 01 - a-2 + mi 



which can be rewritten as 



n + r 2 + 1 + - z (l + r 2 ) < 0. 
01 



(A.6) 



(A.7) 



This is satisfied if (A. 5b) holds because this also implies 1 + r 2 < 0. One shows similarly that 



(A. 5c) is satisfied if p > — 2 . Therefore, we have proved that Mi is asymptotically stable if 



(3.10) and (3.11) hold. 
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A. 3 Calculation of equilibria with two polymorphic loci if p = 



As shown in the main text, by Corollary 3.9 of Nagylaki and Lou (2007) it is sufficient to 
assume that A\B 2 is absent, which implies Dk = Pk(l — Qk) and pk < qt- Setting p = 0, we 
find from the equations p\ = and q± = (2.7) that 



P2 = Pi[mi - ai(l - pi) - /3i(l - gi)]/mi, 
q 2 = 1 - (1 - <?i)(mi + am + Piqi)/mi 



holds at equilibrium. Substituting (A. 8) into p 2 and q 2 , we obtain at equilibrium, 



= Pi[gi(pi,qi) ~ a\a 2 p\ - Plfoqlj/mj, 

= (1 - Qi)[92{pi,qi) ~ ot\a 2 p\ - plfcq\}/m\, 



(A.8a) 
(A.8b) 



(A.9a) 
(A.9b) 



where g\ and 52 are quadratic polynomials in (pi,5i). The obvious substitution results in the 
equilibrium condition 

= aia 2 (ai + /3i)p? + /?i/3 2 (ai + + («i + /3i)(ai/? 2 + a 2 Pi)piqi 
+ [m 1 (ai(2a 2 + /3 2 ) + a 2 ^i) - («i + /3i)(a 2 /3i + «i(a 2 + f3 2 )))p\ 
+ [mi(/3 2 (ai + 202) + a 2 /?i) - A/3 2 (ai + Pi)\q\ 

+ mi[mi(Q2 + /3 2 ) + m 2 (ai + /3i) - (ai + p\)(a 2 + fa)]. (A.lOa) 

It is easy to check that Fo always fulfills this condition and it is the only solution satisfying 
< pi = q% < 1. Hence, unless there is curve (pi, q\) of solutions of (A. 10) that passes through 
Fq and through either a point on p\ = with < q\ < 1 or on q\ = 1 with < p\ < 1, Fq is 



the unique admissible solution of (A. 10). 



Because Fq has an eigenvalue only if either (3.26) is satisfied or if \k\ + k 2 \ = 1 (which 



occurs if and only if Fq collides with either Mi or M4), Fq is the only equilibrium with both 



loci polymorphic, except when (3.26) is satisfied. In the latter case, a line of equilibria exists, 
as we show now. 



We calculate m 2 from (3.26) and substitute into (A. 10). The right-hand side factorizes 



into two linear terms. Only one of them gives rise to admissible equilibria and, in fact, yields 
the manifold: 

qi) - mi] - aiPi(a 2 + f3 2 ) 



Pi 



mij - 
a\9 



(A.ll) 



where < q\ < 1. The allele frequencies in the other deme are obtained from ( A.8| ). It is 
straightforward to check that not only Fo, but also the equilibria Pa,i and Pb, 2 lie on this 
manifold. In terms of the gamete frequencies, this manifold is a straight line. 
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A.4 Stability of F 

In this section we derive the stability of Fq. 



As A1B2 is lost if p = and (2.3) hold, it is sufficient to consider the dynamics (2.5) in £3 x 



S3. In this case, the characteristic polynomial at Fo factors into two quadratic polynomials, 
P(X) = ii(A)i 2 (A). These are given by 



*i(A) =A 2 + [(ai + ft 



a 2 - /S 2 )\/T— ^1^2 
+ (qi + /3i)(a 2 + /3 2 ) [l + (ki - k 2 )\/1 - kik 2 ] , 

t 2 (A) =A 2 + - [ai + a 2 - /3i - /3 2 + (ai - a 2 + /?i - /3 2 )\/l - ^1^2] A 
+ ^ [-ai/3 2 (l + v 7 ! - «i«2) - «2/3i(l - \/l - «i«2)] • 



(mi + m 2 )] A 



(A.12a) 



(A.12b) 



The polynomial ti determines the stability with respect to the (effectively one-locus) system 
where only 'alleles' A\B\ and A2B2 are present. It is convex with t\(fS) > if and only if 



l^i + k 2 | < 1 (where the equalities correspond), i.e., whenever Fo is admissible, cf. (3.23). If 
|^i + k 2 | < 1) ^i(O) > and t\ attains a negative value at its minimum (as can be shown 
easily). Therefore, all eigenvalues emanating from t\ are real and negative whenever Fo is 
admissible. 

The polynomial i 2 determines stability with respect to the interior of 63 x S3. It is convex 
and attains its minimum at 



A, 



1 



[(«! + fa 



where A m i n 
real. As 



a 2 -/3 2 )(l-\/l-KiK2)] (A.13) 
< by (2.3a) and (3.22). As i2(A m in) < 0, the eigenvalues emanating from t 2 are 



t 2 (0) > 



mim 2 < m, 



(A.14) 



where the equalities correspond and rh is defined in (3.27), and because t 2 (0) > 0, we conclude 
that the two eigenvalues emanating from t 2 are negative if and only if ( 3.28| ) holds. 



A.5 Stability of SLPs under p = 



For p = it is sufficient to study the dynamics (2.5 ) in S3 x S3. SLPs where % )2 > (k 
i.e., Pa, 2 and Pb,i, are unstable. It remains to study the stability of Pa,i and Pb,2- 

We present the analysis for Pa 1 in detail, as results for Pb,2 follow analogously. 

At Pa.i the characteristic polynomial factors into two quadratic polynomials, P(X) 
ti(X)t 2 (X), given by 



1,2), 



ii(A) =A 2 + [ai(\/l — 4<Ti 02 — ci) - a! 2 (v / i - 4<Ticr 2 + cr 2 )] A 
+ aia 2 [( a\ - cr 2 )\/i - 4cricr 2 - (1 - 4cti<t 2 )], 



(A.15a) 
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t 2 (A) =>? + \ [2/3 1 + 2/3 2 + a 1 (l 
1 



VI - 4oicr 2 ) + ai(l + \/i - 4cricr 2 )] A 



+ g [A (#2 + «2) + + + 0\/l - ffi<7 2 ] 



(A.15b) 

ii determines stability with respect to the one-locus system where B\ is fixed. ii(0) = if and 
only if + (72 1 = 1, i.e., whenever Pa,i collides with a ME according to ( 3.9a| ) and (3.9b). 



Whenever \<j\ + a 2 \ < 1, i.e., Pa,i is admissible ( |3?f| ), ii(0) > and ^(0) > 0. As %(A) > 
for every A, t\ attains a minimum, where it is straightforward to show that t\ takes a negative 
value at its minimum. Thus, all eigenvalues emanating from t\ are real and negative whenever 
Pa,i is admissible. 

i 2 determines stability with respect to the interior of S3 x S3. £2(0) > 0, if and only if 



m\mi > rh, cf. (3.27), where the equalities correspond. Whenever m\mi > rh, t 2 (0) > 0. 
As i 2 (A) > for every A, t 2 attains a minimum, where it is straightforward to show that t 2 
takes a negative value at its minimum. Thus, all eigenvalues emanating from t\ are real and 
negative whenever mim 2 > rh holds. Otherwise, at least one eigenvalue is positive. 

Combining the results obtained for t\ and i 2 it follows that Pa,i is asymptotically stable 
if and only if 

— 1 < G\ + cr 2 < 1 and rraim 2 > rh (A. 16) 

hold. We note that mim 2 > rh is equivalent to (<7it 2 — o" 2 ti) 2 < — (<7i + ti)(ct 2 + r 2 ), and 
our general assumption (2.3) implies t\ < o\ and a"ir 2 — cr 2 ri < 0. Using these relations 
we can show with the help of Mathematica that (A. 16) is incompatible with —1 < t\ + t 2 . 



Consequently, Pb,2 is not admissible if Pa,i is asymptotically stable. 
A. 6 The super-symmetric case 



We prove that in the super-symmetric case of Section 3.10[ all SLPs are unstable. 

We assume symmetric migration rates {m\ = m 2 = m), equivalent loci (a^ = = a), 
and selection in deme 2 mirrors that in deme 1 (a& = —at*)- Thus, 9 = 0. Equilibria may 
collide (thus leave or enter the state space) if and only if at least one of their eigenvalues 
is zero. Eigenvalues are zeros of the characteristic polynomial, which has the form P(X) = 
cqX 6 + • • • + ciA + Co- If zero is an eigenvalue at an equilibrium, i.e., P (0) = 0, the constant 
term cq must vanish. In the super-symmetric case every characteristic polynomials at an SLP 
has the same constant term 

2 



p)\fa 2 



Co = — a 2 p ^2a 2 \/ a 2 + m 2 + m(3m 
One can show that cq = is impossible if m > 0. 



m 2 )(3m — p)j 



(A.17) 



A. 7 Important quantities and relations 

The following section complements Section 



4.1 



Here, we derive all relations of X (4.2) and 



m 



(4.3) needed in Sections 4.2 to 4.8 and in the proofs of the theorems there. 



5N 



Using (4.9a), (4.9b), (4.5a), (4.5b), (4.12) and (4.13), we derive all possible inequalities 
between to a and to b : 



< m A < m B 



< - 
< - 
< 



A 

m < 



m B < 



-m 



-m 



-m B < m A 



< m A < 



-m 



< 



ot-2 > 02 and (j) < (j)' 



AB 



«2 < fh and 
«2 > fh and 



< 6 < 



i AB 



< < 



, AB , 

J.B 



) < 
^AB 



or 



< < 



(A.18a) 
(A.18b) 

(A.18c) 

(A.18d) 
(A.18e) 



where 



< m B < m A , < —m A < m B , and < m B < —m A are infeasible. 



(A.18f) 



Using (4.6), (4.5), and (4.12)-(4.15) we obtain the following inequalities for m* 



< m* < 
< 

< TO* < TO F ° 



— TO 
-TO F ° < TO* 



0Mi(p = O) < 0< 



< TO F ° < TO 



< m* < 
< m* < 



-TO 



-TO 



< to* < m 



R 

< TO < TO 
< -TO A < TO* 
< —TO < TO 
< TO A < TO* 
< TO B < TO* 



<^ Ml (p = o), 



i Fo <(/)<0 M4 (p = O), 



^(p = 0)< 

<^ Ml (p = o)< 



< 



-AB 



< < 



AB 



<0 < , 

^<0 M *(p = O), 



o), 



6 < 

6 AB 



/. AB 



< 



^(p = 0)< 



(A.19a) 
(A.19b) 
(A.19c) 
(A.19d) 
(A.19e) 
(A.19f) 
(A.19g) 
(A.19h) 
(A.19i) 
(A.19j) 
(A.19k) 
(A.191) 



From ( |4T12D , fl433[ ), ( |Al8| >, and ( |A.19e[ ) - ( |A7l9lD we infer 

min{|m A |, |to b |} < to*. 



(A.20) 



Next, we derive the relations between to f ° and to a or to b needed in the proof of Theorem 
4.6. As their derivation is lengthy, the reader may wish to skip the proof and go immediately 



to the results given by (A.37) and (A.38). 

Our approach to derive the possible relations between m F ° and to a or m B is as follows: 
First, we derive all relevant relations of X (4.2) for arbitrary recombination p. We use these 
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and m M4 for arbitrary p. 



relations to determine the required relations between m A , m B , m Ml 
By setting p = in the results obtained and by the equivalence given in (4.10), the possible 
relations between m F ° and m A or m B follow immediately. 

By definition, the values c/> A , B , Fo , AB , 4> AB , </> AF °, and ^ BF ° (4.2) are independent of 
the recombination rate p. Their relations under (2.3) are given in (4.12), (4.13), and (4.14). 

i,Mi 



The values 



Ma 



and 



IM 4 



(4.2) depend on p, and we analyze this dependence in 
the following. The conditions which determine the admissibility of </> M ' and 4> M] (i = 1,4) are: 



< 
< 
< 
< 



< 1 

< 1 

< 1 

< 1 



with the relations 



< p < -fa or p > —a 2 — fa, 
< p < -a 2 or p > -a 2 - fa, 
< p < ai or p > a\ + fa, 
< p < fa or p > a 2 + fa, 



< <b Ml < <A 



(A.21a) 
(A.21b) 
(A.21c) 
(A.21d) 



< 



^ < 1. 



(A.22a) 
(A.22b) 



< p < -fa = 
< p < a\ = 

To determine further relations of <j) x , <f> Ml , 4> Mi , and (j) M4 , we define the following critical 
recombination rates: 

a2/3i(«2 + fa) ~ aifa(ai + fa) 



26 



+ 



V(a 2 fa(a 2 + fa) - cnMcn + fa)) 2 - A9 2 (a 2 fa + «i/3 2 ) 



20 



-9(ai + a 2 ) + a 2 fa{ - a\fi\ 



20 



+ 



y/(-6( ai + a 2 ) + a 2 0{ - ai/3|) 2 - 40 2 (a 2 fa + «i(a 2 + fa)) 



20 



a\fa(ai + fa) - a 2 fa(a 2 + fa) 



20 



+ 



V(ai/8 2 (ai + fa) ~ a 2 fa(a 2 + fa)) 2 - A9 2 {a 2 fa + a x fa) 



20 



0(fa + fa) + ajfa - ajfa 

20 

V(-0(fa + fa) + ajfa - affa) 2 - 49 2 (a 2 fa + fa( ai + 



+ 



20 



(A.23a) 



(A.23b) 



(A.23c) 



(A.23d) 



Next, we determine the admissibility of p and p defined in (A.23). Therefore, we partition 
the selection parameters satisfying (2.3) and fa > a 2 according to 

aifa(fa - ai) 



fa > a 2 + 



fa(ai + fa- fa) 



> a 2 



(A.24a) 
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and 



° 2 + 1T( iTfl W\ > P2 > «2- 

P\\a.\ + Pi- P2) 



(A.24b) 



Analogously, the selection parameters satisfying (2.3) and 0i > a\ can be partitioned accord- 
ing to 

(A.25a) 



a\a%\a.\ - a 2 ) 
01 > «i + — — > «i 



and 



ai + 



02 (ai - a 2 - P 2 ) 
a\a 2 {a\ — a 2 



> Pi > a\. 



(A.25b) 



02 (ai - a 2 - P 2 ) 

Using these partitions, we obtain that /> x and p x satisfy the following relations (as can be 
checked with Mathematica): 



~m < pm < _ a2 < _ h 

-a 2 = -02 



.Mi 



p u, < pMl 



-02 < p Ml < -ol 2 < p Ml < -a 2 - & 



02 < "2, 

02 = a 2 , 
dA.24a|) holds 



p Ml < -0 2 < -a 2 < p Ml < -a 2 - 2 
ai < p M4 < 0i < p M4 < ai + 0i 



Mi 



(A. 24b) holds 



(A.25a) holds 



p M4 < qi < 0i < p NU < ai + 



M 4 



(A.25b) holds 



As p > and (2.3) hold, we obtain that 

TAB 



-a 2 - 02 or p = p Ml 



TAB 



(.Mi 



and 



,M 4 



B = ^ 



where 



M 4 
M 4 



p = ai + 0i or p = p 
P = P M \ 



M 4 



and 



are infeasible. 



(A.26a) 
(A.26b) 
(A.26c) 
(A.26d) 
(A.26e) 
(A.26f) 



(A.27a) 
(A.27b) 
(A.27c) 



(A.28a) 
(A.28b) 

(A.28c) 



We derive the following relations additinal to (A. 22a) and (A.22b), using (A. 26) and (A.27): 



< <^ Ml < 
6 A < 



< 1 



and 



< 1 



p Ml < p < -a 2 , 
0< P <p M \ 



p M4 <P<Pi, 



(A. 29a) 
(A.29b) 



(A.30a) 
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0<6 M ±< 



0<P<P 



(A.30b) 



and by recalling (4.13): 



JAB 
< 



< <A M1 < <P A 

Ml TAB 



02 < a 2 andO < p < p M \ 



/?2 < 02 and p Ml < p < —ct2- 
b x necessary to deduce the relevant relations between 



(A.31a) 
(A.31b) 



Now we derived all relations between 



in 



Mi 



(m M4 ) and m A , m B . 



First, we note that under ( |2.3[ ), m Ml > if </> < <j) A and m M4 > if cp B < (p. 
In the following, we derive all possible relations between m A , m B , and m Ml where we 

and m Ml is not of particular 



assume that 4> < c/> A (otherwise Mi is unstable, cf. Proposition 



4.1 



interest). By fl4.5a|), (|4.5b[), (|4.12[), (|4.13p, (|A.22a[), (|A.27D, (|A.29D, and QA.3ip, we obtain that 



and 



< -m B < -m A < m Ml 

J/3 2 < a 2 and p < p Ml and (/> AB < c/>< </> Ml , or 
I /3 2 > «2 and p < — /32 and 4> < <fi Ml , 
< -m A < -m B < m Ml 

fp<p Ml and 0<^ AB ,or 
no < «2 and < „„ 

\p Ml <p< -a 2 and </>< </> Ml , 

< -m A = -m B < m Ml f3 2 < «2 and p < p Ml and 



TAB 



(A.32a) 

(A.32b) 
(A.32c) 



< -m B < m Ml < 



-m 



02 < OL2 and p < p Ml and 



(M, 



< < 



f3 2 < a 2 and p Ml < p < p 



,Mi 



and i 



( |A.24a| ) and p < —fi 2 and 
(|A.24a|) and - /3 2 < p < Ml and 



( |A.24a| ) and p Ml < p < -a 2 and 
(|A.24b|) and p < p Ml and 



(A.24b) and p Ml < p < -/3 2 and 



, or 



(.Mi 



<9< , 

< cf) A , or 
/> < (/> A , or 

< <^ Ml ,or 
A 



Wi 



or 



(A. 24b) and - /3 2 < p < -a 2 and <j> < 



1 < (p < 0",or 

Mi 



;mi 



or 



< -m A < m Ml < 



-m 



(A.33a) 



p Ml < p < — a 2 and 

— a 2 < p < — /3 2 and <j> < <j) 



IMi 



/3 2 < a 2 and 



< m Ml < -m B < 



< < 



Mi 



-m 



1 , or 



(A.33b) 
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fa < 0L2 and p Ml < p < p Ml and 
fa < 0L2 and p Ml < p and 



1M1 



< < 



< 



fa > «2 and p 1 < p < —fa and 
fa > 0L2 and — fa < p and <j) < <p A , or 



< ( 



< 0'\ or 
Mi 



< m Ml < 

fa < «2 and 



A 



-m 



p Ml < p < -fa and </. Ml < 
-/3 2 < p and < ^ AB . 



< 



< 



, or 



, or 



IAB 



or 



From (A.18f) it follows that 



< — m A < — m B < m Ml occurs never if fa > ct2, 
< — m A < m Ml < —m B occurs never if fa > 0-2, 
< m Ml < — m A < — m B occurs never if fa > 02- 



(A.33c) 



(A.33d) 



(A.34a) 
(A.34b) 
(A.34c) 



To derive all possible relations between m A , m B , and m M4 we assume <p > 4> B (cf. Propo- 
sition lill) . By ((Oall, d475bb, (14121), ((4131), flA.22bb, fA28l), and (fOSb, we obtain that 



< m A < m B < m M4 
< m A < m M4 < m B 



p < Qi and 



/ M 



< 



(A. 25a) and p < a\ and 
(|A.25al) and ai < p < /5 M4 and 



( |A.25a[ ) and p M4 < p < ft and 
(|A.25bh and p < p M4 and 



< 
IM 4 



4 < 



1M4 



< 



< 



( |A.25b[ ) and p M4 < p < a\ and 
(A. 25b) and ai < p < ft and q 



< < 
ZM 4 



, or 
or 
i, or 
4 ,or 



< < 



1M4 



or 



im 4 



< 



< m Mi <m A <m B 



p"'« < p < fa and B < < </> M4 . 



rM 4 

^ r ^ 

fa< p and </> B < 



or 



From (A.18f) it follows that 



< m B < m A < m M4 occurs never if ql\ < fa, 
< m B < m M4 < m A occurs never if ax < fa, 
< m M4 < m B < m A occurs never if a\ < fa. 



(A.35a) 



(A.35b) 



(A.35c) 



(A.36a) 
(A.36b) 
(A.36c) 



If <fi < <^ A or (f) > <p B , the relations involving m F °, m A and m B follow immediately by (4.10), 
i.e., by setting p = in the relevant formulas in (A.32)-(A.35). The remaining cases where 
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< < 



can be calculated easily using 9 = a\U2 — P1P2, (4.5), (4.15), and (A. 18). Then, 



all admissible relations are: 

< -m A < -m B < -m F ° 



< -m B < -m A < -m F ° 



< m A < -m B < -m F ° 



< -m B < m A < -m F ° 



< m A < -m B < m F ° 



< -m B < m A < m F ° 
< m A < m B < m F ° 
< -m B < -m F ° < -m A 
< -m B < -m F ° < m A 
< m A < m F ° < -m B 
< m A < m F ° < m B 



a.2 > (3 2 and cfi < 4> AB , 

ja 2 > fa and (f> AB < <p< Ml ,or 

\a 2 < fa and <j) < 4> M \ 

6>0 and (j) AB <(/)< Fo , 

j§ < and 4> AF ° <(j)< F °,or 
[6 > and cf> AFo < <f>< AB , 

(6 < and (f> AB < 4>< BF °,or 
[9>0 and (p Fo < <j) < (p BF ° , 

< and F ° < <j) < 

^(p = 0)<6 

^ Mi (p = o)<^<0 a , 



/. AB 



) <(?>< 
(.BFo 



AF 

iB 



< < 
(.B ^ ^ 1M4 



<(f><^) m (p = 0). 

Because other strict inequalities between m A , m B , and m F ° do not occur, we infer 

min{|m A |, |m B |} < |m F °|. 



(A.37a) 
(A.37b) 
(A.37c) 
(A.37d) 

(A.37e) 

(A.37f) 
(A.37g) 
(A.37h) 
(A.37i) 
(A.37j) 
(A.37k) 

(A.38) 
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